JAVA 자료구조 Spring Batch to Read From MongoDB and Generate XML Files

2020.09.21 22:03

Spring Batch to Read From MongoDB and Generate XML Files

We take a look at how to use these two popular and open source database projects together to generate XML file versions of our data.

This article is all about how to use Spring Batch jobs to read data from a Mongo Collection and generate an XML file. This will be very useful for generating reports out of mongoDB using Spring Batch. I was really struggling to get a running Maven project of Spring Batch with MongoDB read operations to generate XML when I was researching it via various internet sources. This running project might be helpful.

Technology stack:

Java 8
Maven 3.5.2
Spring Boot 1.5.2
MongoDB 3.6

The complete, running Maven project can be downloaded from my GitHub repo.

1. pom.xml File

<dependencies>
    <dependency>
        <groupId>org.springframework</groupId>
        <artifactId>spring-oxm</artifactId>
        <version>4.3.7.RELEASE</version>
        <scope>compile</scope>
    </dependency>
    <dependency>
        <groupId>org.springframework.data</groupId>
        <artifactId>spring-data-mongodb</artifactId>
        <version>1.9.8.RELEASE</version>
        <scope>compile</scope>
    </dependency>
    <dependency>
        <groupId>org.springframework.boot</groupId>
        <artifactId>spring-boot-starter-batch</artifactId>
        <version>1.5.2.RELEASE</version>
        <scope>compile</scope>
    </dependency>
    <dependency>
        <groupId>org.springframework.boot</groupId>
        <artifactId>spring-boot-starter-test</artifactId>
        <version>1.5.2.RELEASE</version>
        <scope>test</scope>
    </dependency>
    <dependency>
        <groupId>org.projectlombok</groupId>
        <artifactId>lombok</artifactId>
        <version>1.18.0</version>
        <scope>provided</scope>
    </dependency>
</dependencies>

2) application.properties

spring.data.mongodb.host=127.0.0.1
spring.data.mongodb.port=27017
spring.data.mongodb.database=batchdb

3) Spring Batch Jobs

Create a job that will read from Mongodb and write into an XML file.

경축! 아무것도 안하여 에스천사게임즈가 새로운 모습으로 재오픈 하였습니다.
어린이용이며, 설치가 필요없는 브라우저 게임입니다.
https://s1004games.com

package com.batch.mongo.mongotoxml.jobs;
 
import java.util.HashMap;
import java.util.Map;
import org.springframework.batch.core.Job;
import org.springframework.batch.core.Step;
import org.springframework.batch.core.configuration.annotation.EnableBatchProcessing;
import org.springframework.batch.core.configuration.annotation.JobBuilderFactory;
import org.springframework.batch.core.configuration.annotation.StepBuilderFactory;
import org.springframework.batch.item.data.MongoItemReader;
import org.springframework.batch.item.xml.StaxEventItemWriter;
import org.springframework.beans.factory.annotation.Autowired;
import org.springframework.context.annotation.Bean;
import org.springframework.context.annotation.Configuration;
import org.springframework.core.io.FileSystemResource;
import org.springframework.data.domain.Sort;
import org.springframework.data.domain.Sort.Direction;
import org.springframework.data.mongodb.core.MongoTemplate;
import org.springframework.oxm.xstream.XStreamMarshaller;
 
import com.batch.mongo.mongotoxml.model.Employee;
 
@Configuration
@EnableBatchProcessing
public class MongoDBReader {
 
  @Autowired
  private JobBuilderFactory jobBuilderFactory;
  @Autowired
  private StepBuilderFactory stepBuilderFactory;
 
  @Autowired
  private MongoTemplate mongoTemplate;
 
  @Bean
  public Job readEmployee() throws Exception {
    return jobBuilderFactory.get("readEmployee").flow(step1()).end().build();
  }
 
  @Bean
  public Step step1() throws Exception {
    return stepBuilderFactory.get("step1").<Employee, Employee>chunk(10).reader(reader())
        .writer(writer()).build();
  }
 
 
@Bean
  public MongoItemReader<Employee> reader() {
    MongoItemReader<Employee> reader = new MongoItemReader<>();
    reader.setTemplate(mongoTemplate);
    reader.setSort(new HashMap<String, Sort.Direction>() {{
      put("_id", Direction.DESC);
    }});
    reader.setTargetType(Employee.class);
    reader.setQuery("{}");
    return reader;
  }
 
  @Bean
  public StaxEventItemWriter<Employee> writer() {
    StaxEventItemWriter<Employee> writer = new StaxEventItemWriter<>();
    writer.setResource(new FileSystemResource("xml/employees.xml"));
    writer.setMarshaller(userUnmarshaller());
    writer.setRootTagName("employees");
    return writer;
  }
 
 
@Bean
  public XStreamMarshaller userUnmarshaller() {
    XStreamMarshaller unMarshaller = new XStreamMarshaller();
    Map<String, Class> aliases = new HashMap<String, Class>();
    aliases.put("employee", Employee.class);
    unMarshaller.setAliases(aliases);
    return unMarshaller;
  }
}

4) Fetching a Record From the MongoDB Employee Collection to an Object and Writing it to an XML File.

import java.math.BigDecimal;
import lombok.Data;
import org.springframework.data.mongodb.core.mapping.Document;
import org.springframework.data.annotation.Id;
 
@Data
@Document(collection = "employee")
public class Employee {
	@Id
	private int id;
	private String firstName;
	private String lastName;
	private String department;
	private BigDecimal salary;
}

5) MongoDB Data Insert

{
    "_id" : 1,
    "firstName" : "Peter",
    "lastName" : "Stephen",
    "depertment" : "Technology",
    "salary" : 320.4
}

6) Run the Application

package com.batch.mongo;
 
import org.springframework.boot.SpringApplication;
import org.springframework.boot.autoconfigure.SpringBootApplication;
import org.springframework.boot.autoconfigure.jdbc.DataSourceAutoConfiguration;
 
@SpringBootApplication(exclude = DataSourceAutoConfiguration.class)
public class Application {
 
  public static void main(String[] args) {
    SpringApplication.run(Application.class, args);
  }
}

7) Output

<?xml version="1.0" encoding="UTF-8"?>
<employees>
    <employee>
        <id>3</id>
        <firstName>Joe</firstName>
        <lastName>Spen</lastName>
        <salary>5320.4</salary>
    </employee>
    <employee>
        <id>2</id>
        <firstName>John</firstName>
        <lastName>Sender</lastName>
        <salary>2320.4</salary>
    </employee>
    <employee>
        <id>1</id>
        <firstName>Peter</firstName>
        <lastName>Stephen</lastName>
        <salary>320.4</salary>
    </employee>
</employees>

Hope this will help you to understand Spring Batch with MongoDB read operations. Happy learning!

[출처] https://dzone.com/articles/spring-batch-to-read-from-mongodb-and-generate-xml

본 웹사이트는 광고를 포함하고 있습니다.
광고 클릭에서 발생하는 수익금은 모두 웹사이트 서버의 유지 및 관리, 그리고 기술 콘텐츠 향상을 위해 쓰여집니다.

이 게시물을

번호	제목	글쓴이	날짜	조회 수
62	[maven 설정] Jackson Databind » 2.6.7.1	졸리운_곰	2020.10.05	187
61	[maven 설정] MongoDB Java Driver » 3.12.6	졸리운_곰	2020.10.05	175
60	Maven 에 직접 jar 라이브러리 추가하기!!! ( 외부 repository 사용이 안될때) + scope 정리	졸리운_곰	2020.10.05	169
59	추상(abstract) 클래스가 필요한 기본적인 이유	졸리운_곰	2019.10.30	247
58	Java and JMX - Building Manageable Systems	졸리운_곰	2019.05.26	0
57	[GC] 강제로 GC시키기Java 메모리 full 발생시 강제로 GC 시키기	졸리운_곰	2019.01.22	377
56	Java Map 반복(Iteration)시키는 3가지 방법	졸리운_곰	2019.01.01	347
55	UML: 클래스 다이어그램과 소스코드 매핑	졸리운_곰	2018.04.30	381
54	lombok에 대해서 알아보자	졸리운_곰	2018.04.24	292
53	lombok을 잘 써보자! (2)	졸리운_곰	2018.04.24	318
52	lombok을 잘 써보자! (1)	졸리운_곰	2018.04.24	366
51	[Java] Quartz (쿼츠)를 사용하여 자바 스케줄링(scheduling) 하기	졸리운_곰	2018.02.12	509
50	[subclipse] svn에서 무시할 파일 설정하기 svn:ignore property 설정	졸리운_곰	2017.09.24	286
49	자바에서 C# 호출하기	졸리운_곰	2017.04.26	474
48	Comparison between C# and Java - DiVA.pdf	졸리운_곰	2017.04.25	1017
47	Java Annotation: 인터페이스 강요로부터 자유를…	졸리운_곰	2017.03.20	302
46	Java Naming conventions 자바 명명 규칙	졸리운_곰	2017.03.04	272
45	Timer 클래스를 이용한 작업 스케쥴링	졸리운_곰	2016.11.14	290
44	자바 8 살펴보기	졸리운_곰	2016.05.23	432
43	Java 8 개선 사항 관련 글 모음	졸리운_곰	2016.05.23	409

첫 페이지 1 2 3 4 5 끝 페이지

쓰기

태그