JAVA 자료구조 Spring Batch to Read From MongoDB and Generate XML Files

2020.09.21 22:03

Spring Batch to Read From MongoDB and Generate XML Files

We take a look at how to use these two popular and open source database projects together to generate XML file versions of our data.

This article is all about how to use Spring Batch jobs to read data from a Mongo Collection and generate an XML file. This will be very useful for generating reports out of mongoDB using Spring Batch. I was really struggling to get a running Maven project of Spring Batch with MongoDB read operations to generate XML when I was researching it via various internet sources. This running project might be helpful.

Technology stack:

Java 8
Maven 3.5.2
Spring Boot 1.5.2
MongoDB 3.6

The complete, running Maven project can be downloaded from my GitHub repo.

1. pom.xml File

<dependencies>
    <dependency>
        <groupId>org.springframework</groupId>
        <artifactId>spring-oxm</artifactId>
        <version>4.3.7.RELEASE</version>
        <scope>compile</scope>
    </dependency>
    <dependency>
        <groupId>org.springframework.data</groupId>
        <artifactId>spring-data-mongodb</artifactId>
        <version>1.9.8.RELEASE</version>
        <scope>compile</scope>
    </dependency>
    <dependency>
        <groupId>org.springframework.boot</groupId>
        <artifactId>spring-boot-starter-batch</artifactId>
        <version>1.5.2.RELEASE</version>
        <scope>compile</scope>
    </dependency>
    <dependency>
        <groupId>org.springframework.boot</groupId>
        <artifactId>spring-boot-starter-test</artifactId>
        <version>1.5.2.RELEASE</version>
        <scope>test</scope>
    </dependency>
    <dependency>
        <groupId>org.projectlombok</groupId>
        <artifactId>lombok</artifactId>
        <version>1.18.0</version>
        <scope>provided</scope>
    </dependency>
</dependencies>

2) application.properties

spring.data.mongodb.host=127.0.0.1
spring.data.mongodb.port=27017
spring.data.mongodb.database=batchdb

3) Spring Batch Jobs

Create a job that will read from Mongodb and write into an XML file.

경축! 아무것도 안하여 에스천사게임즈가 새로운 모습으로 재오픈 하였습니다.
어린이용이며, 설치가 필요없는 브라우저 게임입니다.
https://s1004games.com

package com.batch.mongo.mongotoxml.jobs;
 
import java.util.HashMap;
import java.util.Map;
import org.springframework.batch.core.Job;
import org.springframework.batch.core.Step;
import org.springframework.batch.core.configuration.annotation.EnableBatchProcessing;
import org.springframework.batch.core.configuration.annotation.JobBuilderFactory;
import org.springframework.batch.core.configuration.annotation.StepBuilderFactory;
import org.springframework.batch.item.data.MongoItemReader;
import org.springframework.batch.item.xml.StaxEventItemWriter;
import org.springframework.beans.factory.annotation.Autowired;
import org.springframework.context.annotation.Bean;
import org.springframework.context.annotation.Configuration;
import org.springframework.core.io.FileSystemResource;
import org.springframework.data.domain.Sort;
import org.springframework.data.domain.Sort.Direction;
import org.springframework.data.mongodb.core.MongoTemplate;
import org.springframework.oxm.xstream.XStreamMarshaller;
 
import com.batch.mongo.mongotoxml.model.Employee;
 
@Configuration
@EnableBatchProcessing
public class MongoDBReader {
 
  @Autowired
  private JobBuilderFactory jobBuilderFactory;
  @Autowired
  private StepBuilderFactory stepBuilderFactory;
 
  @Autowired
  private MongoTemplate mongoTemplate;
 
  @Bean
  public Job readEmployee() throws Exception {
    return jobBuilderFactory.get("readEmployee").flow(step1()).end().build();
  }
 
  @Bean
  public Step step1() throws Exception {
    return stepBuilderFactory.get("step1").<Employee, Employee>chunk(10).reader(reader())
        .writer(writer()).build();
  }
 
 
@Bean
  public MongoItemReader<Employee> reader() {
    MongoItemReader<Employee> reader = new MongoItemReader<>();
    reader.setTemplate(mongoTemplate);
    reader.setSort(new HashMap<String, Sort.Direction>() {{
      put("_id", Direction.DESC);
    }});
    reader.setTargetType(Employee.class);
    reader.setQuery("{}");
    return reader;
  }
 
  @Bean
  public StaxEventItemWriter<Employee> writer() {
    StaxEventItemWriter<Employee> writer = new StaxEventItemWriter<>();
    writer.setResource(new FileSystemResource("xml/employees.xml"));
    writer.setMarshaller(userUnmarshaller());
    writer.setRootTagName("employees");
    return writer;
  }
 
 
@Bean
  public XStreamMarshaller userUnmarshaller() {
    XStreamMarshaller unMarshaller = new XStreamMarshaller();
    Map<String, Class> aliases = new HashMap<String, Class>();
    aliases.put("employee", Employee.class);
    unMarshaller.setAliases(aliases);
    return unMarshaller;
  }
}

4) Fetching a Record From the MongoDB Employee Collection to an Object and Writing it to an XML File.

import java.math.BigDecimal;
import lombok.Data;
import org.springframework.data.mongodb.core.mapping.Document;
import org.springframework.data.annotation.Id;
 
@Data
@Document(collection = "employee")
public class Employee {
	@Id
	private int id;
	private String firstName;
	private String lastName;
	private String department;
	private BigDecimal salary;
}

5) MongoDB Data Insert

{
    "_id" : 1,
    "firstName" : "Peter",
    "lastName" : "Stephen",
    "depertment" : "Technology",
    "salary" : 320.4
}

6) Run the Application

package com.batch.mongo;
 
import org.springframework.boot.SpringApplication;
import org.springframework.boot.autoconfigure.SpringBootApplication;
import org.springframework.boot.autoconfigure.jdbc.DataSourceAutoConfiguration;
 
@SpringBootApplication(exclude = DataSourceAutoConfiguration.class)
public class Application {
 
  public static void main(String[] args) {
    SpringApplication.run(Application.class, args);
  }
}

7) Output

<?xml version="1.0" encoding="UTF-8"?>
<employees>
    <employee>
        <id>3</id>
        <firstName>Joe</firstName>
        <lastName>Spen</lastName>
        <salary>5320.4</salary>
    </employee>
    <employee>
        <id>2</id>
        <firstName>John</firstName>
        <lastName>Sender</lastName>
        <salary>2320.4</salary>
    </employee>
    <employee>
        <id>1</id>
        <firstName>Peter</firstName>
        <lastName>Stephen</lastName>
        <salary>320.4</salary>
    </employee>
</employees>

Hope this will help you to understand Spring Batch with MongoDB read operations. Happy learning!

[출처] https://dzone.com/articles/spring-batch-to-read-from-mongodb-and-generate-xml

본 웹사이트는 광고를 포함하고 있습니다.
광고 클릭에서 발생하는 수익금은 모두 웹사이트 서버의 유지 및 관리, 그리고 기술 콘텐츠 향상을 위해 쓰여집니다.

이 게시물을

번호	제목	글쓴이	날짜	조회 수
350	Jackson 라이브러리를 활용한 Map to Json Serialization 처리	졸리운_곰	2020.09.24	249
349	Mybatis selectMap 예제	졸리운_곰	2020.09.24	2362
348	스프링 myBatis JSON 형식 입력하고 출력하기 : Spring myBatis JSONType input output	졸리운_곰	2020.09.24	274
347	Java code example to export from database to CSV file	졸리운_곰	2020.09.24	205
346	Export Oracle table to CSV file in Java 오라클 테이블을 CSV 파일로 변환	졸리운_곰	2020.09.24	760
345	Spring Batch and MongoDB	졸리운_곰	2020.09.21	307
»	Spring Batch to Read From MongoDB and Generate XML Files	졸리운_곰	2020.09.21	160
343	Spring Batch Goodies With MongoDB	졸리운_곰	2020.09.21	143
342	MongoBatis Ver 1.04 in SpringFrameWork (mongoDB + MyBatis)	졸리운_곰	2020.09.21	207
341	Spring 몽고DB 연동	졸리운_곰	2020.09.21	182
340	MongoDB CRUD with Java Driver 몽고디비 java 연결 및 CRUD 테스트	졸리운_곰	2020.09.21	777
339	LinkedList - Java 구현	졸리운_곰	2020.03.25	181
338	How to use Weka in your Java code	졸리운_곰	2020.02.01	307
337	weka and java eclipse example : A Simple Machine Learning Example in Java	졸리운_곰	2020.01.31	362
336	머신러닝? weka	졸리운_곰	2020.01.31	357
335	[Weka] Weka를 이용한 Iris 데이터 머신러닝	졸리운_곰	2020.01.30	363
334	[강좌] WEKA 사용법 (간단한 분류, 의사결정트리 분석 설명)	졸리운_곰	2020.01.30	343
333	MyBatis 에서 procedure 처리	졸리운_곰	2020.01.27	1142
332	neo4j 시작하기	졸리운_곰	2019.12.25	256
331	Neo4J Cypher 가이드	졸리운_곰	2019.12.25	273

첫 페이지 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 끝 페이지

쓰기

태그