JAVA 자료구조 Spring Batch to Read From MongoDB and Generate XML Files

2020.09.21 22:03

Spring Batch to Read From MongoDB and Generate XML Files

We take a look at how to use these two popular and open source database projects together to generate XML file versions of our data.

This article is all about how to use Spring Batch jobs to read data from a Mongo Collection and generate an XML file. This will be very useful for generating reports out of mongoDB using Spring Batch. I was really struggling to get a running Maven project of Spring Batch with MongoDB read operations to generate XML when I was researching it via various internet sources. This running project might be helpful.

Technology stack:

Java 8
Maven 3.5.2
Spring Boot 1.5.2
MongoDB 3.6

The complete, running Maven project can be downloaded from my GitHub repo.

1. pom.xml File

<dependencies>
    <dependency>
        <groupId>org.springframework</groupId>
        <artifactId>spring-oxm</artifactId>
        <version>4.3.7.RELEASE</version>
        <scope>compile</scope>
    </dependency>
    <dependency>
        <groupId>org.springframework.data</groupId>
        <artifactId>spring-data-mongodb</artifactId>
        <version>1.9.8.RELEASE</version>
        <scope>compile</scope>
    </dependency>
    <dependency>
        <groupId>org.springframework.boot</groupId>
        <artifactId>spring-boot-starter-batch</artifactId>
        <version>1.5.2.RELEASE</version>
        <scope>compile</scope>
    </dependency>
    <dependency>
        <groupId>org.springframework.boot</groupId>
        <artifactId>spring-boot-starter-test</artifactId>
        <version>1.5.2.RELEASE</version>
        <scope>test</scope>
    </dependency>
    <dependency>
        <groupId>org.projectlombok</groupId>
        <artifactId>lombok</artifactId>
        <version>1.18.0</version>
        <scope>provided</scope>
    </dependency>
</dependencies>

2) application.properties

spring.data.mongodb.host=127.0.0.1
spring.data.mongodb.port=27017
spring.data.mongodb.database=batchdb

3) Spring Batch Jobs

Create a job that will read from Mongodb and write into an XML file.

경축! 아무것도 안하여 에스천사게임즈가 새로운 모습으로 재오픈 하였습니다.
어린이용이며, 설치가 필요없는 브라우저 게임입니다.
https://s1004games.com

package com.batch.mongo.mongotoxml.jobs;
 
import java.util.HashMap;
import java.util.Map;
import org.springframework.batch.core.Job;
import org.springframework.batch.core.Step;
import org.springframework.batch.core.configuration.annotation.EnableBatchProcessing;
import org.springframework.batch.core.configuration.annotation.JobBuilderFactory;
import org.springframework.batch.core.configuration.annotation.StepBuilderFactory;
import org.springframework.batch.item.data.MongoItemReader;
import org.springframework.batch.item.xml.StaxEventItemWriter;
import org.springframework.beans.factory.annotation.Autowired;
import org.springframework.context.annotation.Bean;
import org.springframework.context.annotation.Configuration;
import org.springframework.core.io.FileSystemResource;
import org.springframework.data.domain.Sort;
import org.springframework.data.domain.Sort.Direction;
import org.springframework.data.mongodb.core.MongoTemplate;
import org.springframework.oxm.xstream.XStreamMarshaller;
 
import com.batch.mongo.mongotoxml.model.Employee;
 
@Configuration
@EnableBatchProcessing
public class MongoDBReader {
 
  @Autowired
  private JobBuilderFactory jobBuilderFactory;
  @Autowired
  private StepBuilderFactory stepBuilderFactory;
 
  @Autowired
  private MongoTemplate mongoTemplate;
 
  @Bean
  public Job readEmployee() throws Exception {
    return jobBuilderFactory.get("readEmployee").flow(step1()).end().build();
  }
 
  @Bean
  public Step step1() throws Exception {
    return stepBuilderFactory.get("step1").<Employee, Employee>chunk(10).reader(reader())
        .writer(writer()).build();
  }
 
 
@Bean
  public MongoItemReader<Employee> reader() {
    MongoItemReader<Employee> reader = new MongoItemReader<>();
    reader.setTemplate(mongoTemplate);
    reader.setSort(new HashMap<String, Sort.Direction>() {{
      put("_id", Direction.DESC);
    }});
    reader.setTargetType(Employee.class);
    reader.setQuery("{}");
    return reader;
  }
 
  @Bean
  public StaxEventItemWriter<Employee> writer() {
    StaxEventItemWriter<Employee> writer = new StaxEventItemWriter<>();
    writer.setResource(new FileSystemResource("xml/employees.xml"));
    writer.setMarshaller(userUnmarshaller());
    writer.setRootTagName("employees");
    return writer;
  }
 
 
@Bean
  public XStreamMarshaller userUnmarshaller() {
    XStreamMarshaller unMarshaller = new XStreamMarshaller();
    Map<String, Class> aliases = new HashMap<String, Class>();
    aliases.put("employee", Employee.class);
    unMarshaller.setAliases(aliases);
    return unMarshaller;
  }
}

4) Fetching a Record From the MongoDB Employee Collection to an Object and Writing it to an XML File.

import java.math.BigDecimal;
import lombok.Data;
import org.springframework.data.mongodb.core.mapping.Document;
import org.springframework.data.annotation.Id;
 
@Data
@Document(collection = "employee")
public class Employee {
	@Id
	private int id;
	private String firstName;
	private String lastName;
	private String department;
	private BigDecimal salary;
}

5) MongoDB Data Insert

{
    "_id" : 1,
    "firstName" : "Peter",
    "lastName" : "Stephen",
    "depertment" : "Technology",
    "salary" : 320.4
}

6) Run the Application

package com.batch.mongo;
 
import org.springframework.boot.SpringApplication;
import org.springframework.boot.autoconfigure.SpringBootApplication;
import org.springframework.boot.autoconfigure.jdbc.DataSourceAutoConfiguration;
 
@SpringBootApplication(exclude = DataSourceAutoConfiguration.class)
public class Application {
 
  public static void main(String[] args) {
    SpringApplication.run(Application.class, args);
  }
}

7) Output

<?xml version="1.0" encoding="UTF-8"?>
<employees>
    <employee>
        <id>3</id>
        <firstName>Joe</firstName>
        <lastName>Spen</lastName>
        <salary>5320.4</salary>
    </employee>
    <employee>
        <id>2</id>
        <firstName>John</firstName>
        <lastName>Sender</lastName>
        <salary>2320.4</salary>
    </employee>
    <employee>
        <id>1</id>
        <firstName>Peter</firstName>
        <lastName>Stephen</lastName>
        <salary>320.4</salary>
    </employee>
</employees>

Hope this will help you to understand Spring Batch with MongoDB read operations. Happy learning!

[출처] https://dzone.com/articles/spring-batch-to-read-from-mongodb-and-generate-xml

본 웹사이트는 광고를 포함하고 있습니다.
광고 클릭에서 발생하는 수익금은 모두 웹사이트 서버의 유지 및 관리, 그리고 기술 콘텐츠 향상을 위해 쓰여집니다.

이 게시물을

번호	제목	글쓴이	날짜	조회 수
18	[java 인공지능] Spring AI 로 ChatGPT API 만들기	졸리운_곰	2024.12.30	214
17	[java 인공지능] 오라클, 자바 머신러닝 라이브러리 ‘트리뷰오’ 오픈소스로 공개	졸리운_곰	2023.08.27	296
16	[java 인공지능] 자바를 위한 머신 러닝 라이브러리	졸리운_곰	2023.08.27	360
15	[Java 인공지능] 오라클, 자바 머신러닝 라이브러리 ‘트리뷰오’ 오픈소스로 공개	졸리운_곰	2023.08.13	358
14	[java 인공지능] [java] 라이프 게임 (life game)	졸리운_곰	2021.10.19	337
13	How to use Weka in your Java code	졸리운_곰	2020.02.01	307
12	weka and java eclipse example : A Simple Machine Learning Example in Java	졸리운_곰	2020.01.31	362
11	머신러닝? weka	졸리운_곰	2020.01.31	357
10	[Weka] Weka를 이용한 Iris 데이터 머신러닝	졸리운_곰	2020.01.30	363
9	[강좌] WEKA 사용법 (간단한 분류, 의사결정트리 분석 설명)	졸리운_곰	2020.01.30	343
8	[JESS] Jess , 이클립스 연동	졸리운_곰	2019.12.22	215
7	Jess 간단한 문법 요약	졸리운_곰	2019.12.22	277
6	Jess 6.1 다운로드 friedman-hill_src_1_jess_se	졸리운_곰	2019.12.22	184
5	java artificial intelligence Rule Engine Jess Working Memory	졸리운_곰	2019.12.22	300
4	Defining Functions in Jess	졸리운_곰	2019.12.22	389
3	Jess Language Basics	졸리운_곰	2019.12.22	272
2	Embedding Jess in a Java Application	졸리운_곰	2019.12.22	298
1	다섯개의 탑 자바로 머신러닝 라이브러리 Top 5 machine learning libraries for Java	졸리운_곰	2017.08.22	388

첫 페이지 1 끝 페이지

쓰기

태그