[MongoDB] MongoDB upsert example using Mongo Shell and Java Driver 

MongoDB upsert option is used with update method which creates a new document if the query does not retrieve any documents satisfying the criteria. The default value for this option is false. The upsert option does an insert based on the field and value pairs specified in the update parameter or field and value pairs specified in both query and update parameter.

Upsert option set for update

This operation first searches for the document if not present then inserts the new document into the database.

> db.car.update(
...    { name: "Qualis" },
...    {
...       name: "Qualis",
...       speed: 50
...    },
...    { upsert: true }
... )
WriteResult({
	"nMatched" : 0,
	"nUpserted" : 1,
	"nModified" : 0,
	"_id" : ObjectId("548d3a955a5072e76925dc1c")
})
> 

The car with the name Qualis is checked for existence and if not, a document with car name “Qualis” and speed 50 is inserted into the database. The nUpserted with value “1” indicates a new document is inserted.

Note that to avoid inserting the same document more than once, create an index on the name field thereby ensuring that the document will be inserted only once for the upsert option on every update specified. If the upsert fails because of duplicate index key error, retrying results in the successful update operation.

Bulk.find.upsert()

The upsert operation can be used for multiple documents or in bulk with the methods-update, updateOne and replaceOne.

The syntax for upsert option is

 

Bulk.find(<query>).upsert().update(<update>);
Bulk.find(<query>).upsert().updateOne(<update>);
Bulk.find(<query>).upsert().replaceOne(<replacement>);

Upsert option set for find() method in bulk

The upsert operation for multiple documents in find method inserts a single document if the query does not satisfy the criteria as specified in the input parameter.


> var car = db.car.initializeUnorderedBulkOp();
> car.find( { name: "Chevrolet" } ).upsert().update(
...    {
...      $setOnInsert: { name: "Chevrolet",speed:55,regno:567,color: "AshBrown" },
...       $set: { cno:"H768" }
...    }
... );
> car.execute();
BulkWriteResult({
	"writeErrors" : [ ],
	"writeConcernErrors" : [ ],
	"nInserted" : 0,
	"nUpserted" : 1,
	"nMatched" : 0,
	"nModified" : 0,
	"nRemoved" : 0,
	"upserted" : [
		{
			"index" : 0,
			"_id" : ObjectId("548d3b475a5072e76925dc1d")
		}
	]
})
> 

This operation first initialize and creates an unordered bulk list named “car” and then calls the find method with upsert option in update. The Insert field and value pairs are specified with $setOnInsert tag to insert if the document is not present. The $set is specified to update the “cno” for the car if the document already exists. Finally bulk execute method is called to execute either the insert or update statements. Since the document is not present insertion is done first and upon that the cno is updated for the inserted record.

Upsert option set for updateOne method in bulk

This method accepts parameters for updation as field/key and value pairs.

경축! 아무것도 안하여 에스천사게임즈가 새로운 모습으로 재오픈 하였습니다.
어린이용이며, 설치가 필요없는 브라우저 게임입니다.
https://s1004games.com

 


> var car = db.car.initializeUnorderedBulkOp();
> car.find( { name: "Ferrari" } ).upsert().updateOne(
...    {
...      name: "Ferrari",
...      speed:67,
...      regno:456,  
...      color: "ChromeRed"
...    }
... );
> car.execute();
BulkWriteResult({
	"writeErrors" : [ ],
	"writeConcernErrors" : [ ],
	"nInserted" : 0,
	"nUpserted" : 1,
	"nMatched" : 0,
	"nModified" : 0,
	"nRemoved" : 0,
	"upserted" : [
		{
			"index" : 0,
			"_id" : ObjectId("548d57525a5072e76925dc1e")
		}
	]
})
> 

This creates an unordered bulk list with upsert option and inserts the “ferrari” document if not found in the updateOne method using the field and value pairs specified.

Upsert set for updateOne using update operators

This uses the update operators for setting the values for the fields. $setOnInsert and $set are the operators.


> var car = db.car.initializeUnorderedBulkOp();
> car.find( { speed:67,regno:768} ).upsert().updateOne(
...    {
...      $setOnInsert: { name:"Audi"},
...       $set: { speed: 89 }
...    }
... );
> car.execute();
BulkWriteResult({
	"writeErrors" : [ ],
	"writeConcernErrors" : [ ],
	"nInserted" : 0,
	"nUpserted" : 1,
	"nMatched" : 0,
	"nModified" : 0,
	"nRemoved" : 0,
	"upserted" : [
		{
			"index" : 0,
			"_id" : ObjectId("548d57b35a5072e76925dc1f")
		}
	]
})
> 

The value of name is set using $setonInsert and update is done using $set operators.

Upsert option set for replaceOne method in bulk

This performs an insert using the replaceOne method by accepting field and value pairs only as the argument.


> var car = db.car.initializeUnorderedBulkOp();
> car.find( { name: "Skoda" } ).upsert().replaceOne(
...    {
...      name: "Skoda",
...      cno: "H7865",
...      speed: 80,
...    }
... );
> car.execute();
BulkWriteResult({
	"writeErrors" : [ ],
	"writeConcernErrors" : [ ],
	"nInserted" : 0,
	"nUpserted" : 1,
	"nMatched" : 0,
	"nModified" : 0,
	"nRemoved" : 0,
	"upserted" : [
		{
			"index" : 0,
			"_id" : ObjectId("548d58205a5072e76925dc20")
		}
	]
})
> 

This performs an insertion of document and this inserted document is the replacement document.

Java Program for MongoDB upsert

In this section we will write a java program to work on the upsert option with update, updateOne and replaceOne methods.


package com.journaldev.mongodb;

import com.mongodb.BasicDBObject;
import com.mongodb.BulkWriteOperation;
import com.mongodb.DB;
import com.mongodb.DBCollection;
import com.mongodb.DBCursor;
import com.mongodb.MongoClient;
import com.mongodb.WriteResult;
import java.net.UnknownHostException;

public class MongoDBUpsert {

	public static void upsertTrue() throws UnknownHostException {

		MongoClient m1 = new MongoClient("localhost");

		DB db = m1.getDB("test");

		DBCollection coll = db.getCollection("car");

		BasicDBObject o1 = new BasicDBObject();

		o1.append("$set", new BasicDBObject("name", "Innova"));

		BasicDBObject query = new BasicDBObject().append("speed", 56);

		WriteResult c1 = coll.update(query, o1, true, false);

		DBCursor carcursor = coll.find();

		try {
			while (carcursor.hasNext()) {
				System.out.println(carcursor.next());
			}
		} finally {
			carcursor.close();
		}

	}

	public static void upsertBulkUnorderedDocsForUpdate()
			throws UnknownHostException {

		// Get a new connection to the db assuming that it is running

		MongoClient mongoClient = new MongoClient("localhost");

		// //use test as a datbase,use your database here
		DB db = mongoClient.getDB("test");

		// //fetch the collection object ,car is used here,use your own
		DBCollection coll = db.getCollection("car");

		// intialize and create a unordered bulk
		BulkWriteOperation b1 = coll.initializeUnorderedBulkOperation();

		BasicDBObject o1 = new BasicDBObject();

		o1.append("$setOnInsert",
				new BasicDBObject("name", "innova").append("speed", 54));
		o1.append("$set", new BasicDBObject("cno", "H456"));

		b1.find(new BasicDBObject("name", "Zen")).upsert().update(o1);

		b1.execute();

		DBCursor c1 = coll.find();

		System.out.println("---------------------------------");

		try {
			while (c1.hasNext()) {
				System.out.println(c1.next());
			}
		} finally {
			c1.close();
		}

	}

	public static void upsertBulkUnordereDocsForUpdateOne()
			throws UnknownHostException {

		// Get a new connection to the db assuming that it is running

		MongoClient mongoClient = new MongoClient("localhost");

		// use test as a database,use your database here
		DB db = mongoClient.getDB("test");

		// fetch the collection object ,car is used here,use your own
		DBCollection coll = db.getCollection("car");

		// intialize and create a unordered bulk
		BulkWriteOperation b1 = coll.initializeUnorderedBulkOperation();

		BasicDBObject o1 = new BasicDBObject();

		o1.append(
				"$setOnInsert",
				new BasicDBObject("name", "Xylo").append("speed", 67).append(
						"cno", "H654"));

		b1.find(new BasicDBObject("name", "Xylo")).upsert().updateOne(o1);

		b1.execute();

		DBCursor c1 = coll.find();

		System.out.println("---------------------------------");

		try {
			while (c1.hasNext()) {
				System.out.println(c1.next());
			}
		} finally {
			c1.close();
		}

	}

	public static void upsertBulkForUpdateOneWithOperators()
			throws UnknownHostException {

		// Get a new connection to the db assuming that it is running

		MongoClient mongoClient = new MongoClient("localhost");

		// //use test as a datbase,use your database here
		DB db = mongoClient.getDB("test");

		// //fetch the collection object ,car is used here,use your own
		DBCollection coll = db.getCollection("car");

		// intialize and create a unordered bulk
		BulkWriteOperation b1 = coll.initializeOrderedBulkOperation();

		BasicDBObject o1 = new BasicDBObject();

		// insert if document not found and set the fields with updated value
		o1.append("$setOnInsert", new BasicDBObject("cno", "H123"));
		o1.append("$set", new BasicDBObject("speed", "63"));

		b1.find(new BasicDBObject("name", "Santro").append("speed", 654))
				.upsert().updateOne(o1);

		b1.execute();

		DBCursor c1 = coll.find();

		System.out.println("---------------------------------");

		try {
			while (c1.hasNext()) {
				System.out.println(c1.next());
			}
		} finally {
			c1.close();
		}

	}

	public static void upsertBulkUnorderedDocsForReplaceOne()
			throws UnknownHostException {

		// Get a new connection to the db assuming that it is running

		MongoClient mongoClient = new MongoClient("localhost");

		// //use test as a datbase,use your database here
		DB db = mongoClient.getDB("test");

		// fetch the collection object ,car is used here,use your own
		DBCollection coll = db.getCollection("car");

		// intialize and create a unordered bulk
		BulkWriteOperation b1 = coll.initializeOrderedBulkOperation();

		// insert query
		BasicDBObject o1 = new BasicDBObject("name", "Qualis").append("speed",
				76).append("color", "Palebrown");

		b1.find(new BasicDBObject("name", "Qualis")).upsert().replaceOne(o1);

		b1.execute();

		DBCursor c1 = coll.find();

		System.out.println("---------------------------------");

		try {
			while (c1.hasNext()) {
				System.out.println(c1.next());
			}
		} finally {
			c1.close();
		}

	}

	public static void main(String[] args) throws UnknownHostException {

		// invoke all the methods
		upsertTrue();
		upsertBulkUnorderedDocsForUpdate();
		upsertBulkUnordereDocsForUpdateOne();
		upsertBulkForUpdateOneWithOperators();
		upsertBulkUnorderedDocsForReplaceOne();

	}

}

Output of the above program when executed for a collection that doesn’t exists produce following results.


{ "_id" : { "$oid" : "548d59285a5072e76925dc25"} , "speed" : 56 , "name" : "Innova"}
---------------------------------
{ "_id" : { "$oid" : "548d59285a5072e76925dc25"} , "speed" : 56 , "name" : "Innova"}
{ "_id" : { "$oid" : "548d59285a5072e76925dc26"} , "name" : "innova" , "speed" : 54 , "cno" : "H456"}
---------------------------------
{ "_id" : { "$oid" : "548d59285a5072e76925dc25"} , "speed" : 56 , "name" : "Innova"}
{ "_id" : { "$oid" : "548d59285a5072e76925dc26"} , "name" : "innova" , "speed" : 54 , "cno" : "H456"}
{ "_id" : { "$oid" : "548d59285a5072e76925dc27"} , "name" : "Xylo" , "speed" : 67 , "cno" : "H654"}
---------------------------------
{ "_id" : { "$oid" : "548d59285a5072e76925dc25"} , "speed" : 56 , "name" : "Innova"}
{ "_id" : { "$oid" : "548d59285a5072e76925dc26"} , "name" : "innova" , "speed" : 54 , "cno" : "H456"}
{ "_id" : { "$oid" : "548d59285a5072e76925dc27"} , "name" : "Xylo" , "speed" : 67 , "cno" : "H654"}
{ "_id" : { "$oid" : "548d59285a5072e76925dc28"} , "name" : "Santro" , "speed" : "63" , "cno" : "H123"}
---------------------------------
{ "_id" : { "$oid" : "548d59285a5072e76925dc25"} , "speed" : 56 , "name" : "Innova"}
{ "_id" : { "$oid" : "548d59285a5072e76925dc26"} , "name" : "innova" , "speed" : 54 , "cno" : "H456"}
{ "_id" : { "$oid" : "548d59285a5072e76925dc27"} , "name" : "Xylo" , "speed" : 67 , "cno" : "H654"}
{ "_id" : { "$oid" : "548d59285a5072e76925dc28"} , "name" : "Santro" , "speed" : "63" , "cno" : "H123"}
{ "_id" : { "$oid" : "548d59285a5072e76925dc29"} , "name" : "Qualis" , "speed" : 76 , "color" : "Palebrown"}

That’s all for MongoDB upsert method with different scenario examples, we will look into more of MongoDB features in coming posts.

 

[출처] https://www.journaldev.com/6324/mongodb-upsert-example-using-mongo-shell-and-java-driver

본 웹사이트는 광고를 포함하고 있습니다.
광고 클릭에서 발생하는 수익금은 모두 웹사이트 서버의 유지 및 관리, 그리고 기술 콘텐츠 향상을 위해 쓰여집니다.
번호 제목 글쓴이 날짜 조회 수
공지 오라클 기본 샘플 데이터베이스 졸리운_곰 2014.01.02 86103
공지 [SQL컨셉] 서적 "SQL컨셉"의 샘플 데이타 베이스 SAMPLE DATABASE of ORACLE 가을의 곰을... 2013.02.10 78620
공지 [G_SQL] Sample Database 가을의 곰을... 2012.05.20 95334
78 [Kafka] Kafka 한번 살펴보자... Quickstart file 졸리운_곰 2021.06.18 1308
77 Java Kafka Producer, Consumer 예제 구현 Java를 이용하여 Kafka Producer와 Kakfa Consumer를 구현해보자. file 졸리운_곰 2021.06.18 1167
76 Beginner’s Guide to Understand Kafka file 졸리운_곰 2021.06.18 1570
75 [Kafka] Kafka 설치/실행 및 테스트 file 졸리운_곰 2021.06.18 1065
74 [java] [kafka] [Kafka] 개념 및 기본예제 file 졸리운_곰 2021.06.16 2170
73 Getting started with Apache Kafka in Python file 졸리운_곰 2020.09.10 2254
72 [Kafka] 다운로드 및 Quick Start file 졸리운_곰 2020.09.07 1890
71 [Kafka] 기본 개념잡기 file 졸리운_곰 2020.09.07 1704
70 Flume Integration with Kafka file 졸리운_곰 2019.04.16 2081
69 빅데이터: 플럼(Flume) 토폴로지 설계 file 졸리운_곰 2019.04.16 1600
68 실시간 처리를 위한 분산 메시징 시스템 카프카(Kafka) file 졸리운_곰 2018.05.12 1409
67 Flume과 Kafka를 사용한 초당 100만개 로그 수집 테스트 file 졸리운_곰 2018.05.12 1374
66 웹 크롤링 / web crwaling / web scraping / 웹 스크래핑 file 졸리운_곰 2017.07.09 1846
65 빅데이터 단지 몇퍼센트의 예측 정확성을 위하여 장애로 가득찬 빅데이터 시스템을 도입하여야 하는가에 대한 의문! file 졸리운_곰 2017.03.20 1603
64 빅데이터: 플럼(Flume) 토폴로지 설계 file 졸리운_곰 2017.03.20 1415
63 [실시간 분석 시스템] Apache Flume를 활용한 데이터 수집(1) file 졸리운_곰 2017.03.06 1316
62 [실시간 분석 시스템] 데이터 수집 #2 Apache Sqoop을 활용하여 RDBMS 데이터 수집(2) file 졸리운_곰 2017.03.06 1383
61 [실시간 분석 시스템] 데이터 수집 #2 Apache Sqoop을 활용하여 RDBMS 데이터 수집(1) file 졸리운_곰 2017.03.06 1101
60 [실시간 분석 시스템] 데이터 수집 #1 오픈 소스 수집기 비교 file 졸리운_곰 2017.03.06 1744
59 [실시간 분석 시스템] 일단 데이터 들여다 보기 file 졸리운_곰 2017.03.06 1933
대표 김성준 주소 : 경기 용인 분당수지 U타워 등록번호 : 142-07-27414
통신판매업 신고 : 제2012-용인수지-0185호 출판업 신고 : 수지구청 제 123호 개인정보보호최고책임자 : 김성준 sjkim70@stechstar.com
대표전화 : 010-4589-2193 [fax] 02-6280-1294 COPYRIGHT(C) stechstar.com ALL RIGHTS RESERVED