August 2010
2 posts
2 tags
MongoDB and Twilio Contest
MongoDB and Twilio are teaming up this week to do a contest! You have until midnight on August 22nd to create an application using Twilio and MongoDB. The best application wins:
A netbook
$100 of Twilio credit
MongoDB Timbuk2 Laptop Bag (the only other ways to get one are to be a major contributor or write a MongoDB book)
MongoDB T-shirt
MongoDB Coffee Mug
MongoDB Stickers
It’s...
MongoDB 1.6 Released
MongoDB 1.6.0 is the fourth stable major release (even numbers are “stable” : 1.0, 1.2, 1.4, …) and is the culmination of the 1.5 development series.
Scale-out
The focus of the 1.6 release is scale-out. Sharding is now production-ready. The combination of sharding and replica sets allows one to build out horizontally scalable data storage clusters with no single points...
July 2010
1 post
Node.js and MongoDB
Node.js is turning out to be a framework of choice for building real-time applications of all kinds, from analytics systems to chat servers to location-based tracking services. If you’re still new to Node, check out Simon Willison’s excellent introductory post. If you’re already using Node, you probably need a database, and you just might have considered using MongoDB.
The...
June 2010
3 posts
Blog Contest Winners!
We’re pleased to announce the winner’s of the MongoDB blogging contest!
Grand Prize
Why (and How) I Replaced Amazon SQS with MongoDB - Matt Insler
Runners Up
Running MongoDb on Microsoft Windows Azure with CloudDrive - Simon Green
Using MongoDB for CodeIgniter Logs - Tom Schlick
Integrating MongoDB with Spring Batch - Baruch Sadogursky
The winners should contact...
Highlights from MongoNYC
On May 21, 10gen organized the second conference dedicated to MongoDB. Like MongoSF, MongoNYC included a great line-up of speakers. One of the more popular talks was Kyle Banker’s Schema Design session, which was so crowded that many attendees sat on the floor! Both the video and slides from the talk are now available.
Also interesting were the many talks on MongoDB production...
5 tags
Holy Large Hadron Collider, Batman!
Valentin Kuznetsov just presented a paper at the International Conference on Computational Science on CERN’s use of MongoDB for Large Hadron Collider data. The paper, The CMS Data Aggregation System, is available as a PDF at ScienceDirect.
A summary
“CMS” stands for Compact Muon Solenoid, a general-purpose particle physics detector built on the Large Hadron Collider. The...
May 2010
3 posts
Write a blog post on MongoDB for a chance to win a...
10gen has a ticket to OSCON that we’d like to give to a MongoDB user.
How to Enter
Write a blog post. It has to be about MongoDB, but within that it can be anything: a how-to, an experience you had, a review, a rant, a rave, a technical piece, a humorous piece… whatever you want.
Post your blog at mongodb.slinkset.com and include your contact information in the description. You...
MongoSF Slides & Video; Discounts on upcoming...
MongoSF, the first full-day conference dedicated to MongoDB, featured 35+ sessions and even produced a few surprises along the way. Over 200 people attended the April 30 conference. Slides and video from many sessions now available on the 10gen website.
The Sharding presentation was one of the major highlights of the event. Eliot Horowitz, the CTO of 10gen, demoed a 25-node cluster on EC2. Check...
MongoDB Conferences in London and Paris in June
MongoDB conferences are coming to Europe! MongoUK is on Friday, June 18 at Skills Matter and MongoFR is on Monday, June 21 at La Cantine. Each conference will feature sessions from the 10gen team on schema design, replication, sharding, indexing, and map/reduce. In addition, attendees will learn about MongoDB in production through presentations by companies like Boxed Ice, Silentale, OCW Search,...
April 2010
6 posts
MongoDB Q1 Download Numbers
The MongoDB team is very excited about how the developer community is building around MongoDB, and we wanted to share some numbers.
These are download numbers for the core server for January through March. It is exactly the number of downloads of the core database from downloads.mongodb.org minus all bots (all known plus anything with bot in the user-agent) and all other crawlers we...
5 tags
On Distributed Consistency - Part 6 - Consistency...
See also:
Part 1 - Introduction and CAP
Part 2 - Eventual Consistency
Part 3 - Network Partitions
Part 4 - Multi Data Center
Part 5 - Multi Writer Eventual Consistency
The following diagram (click for large version) shows the various consistency models that have been discussed in this blog post series. Stronger consistency modes generally meet the requirements of weaker modes, and are...
3 tags
On Distributed Consistency - Part 5 - Many Writer...
See also:
Part 1 - Introduction and CAP
Part 2 - Eventual Consistency
Part 3 - Network Partitions
Part 4 - Multi Data Center
Part 6 - Consistency Chart
In part 2 we primarily discussed “single writer” eventual consistency. Here we will discuss many-writer, and define that term more precisely.
By many-writer, we mean a system where different data servers can receive writes...
2 tags
On Distributed Consistency - Part 4 - Multi Data...
See also:
Part 1 - Introduction and CAP
Part 2 - Eventual Consistency
Part 3 - Network Partitions
Part 5 - Multi Writer Eventual Consistency
Part 6 - Consistency Chart
Eventual consistency makes multi-data center data storage easier. There are reasons eventual consistency is helpful for multi-data center that are unrelated to availability and CAP. And as mentioned in Part 3, some...
On Distributed Consistency - Part 3 - Network...
See also:
Part 1 - Introduction and CAP
Part 2 - Eventual Consistency
Part 4 - Multi Data Center
Part 5 - Multi Writer Eventual Consistency
Part 6 - Consistency Chart
It’s fascinating that the formal theorem statement for CAP, in the first proof (that I know of), doesn’t use the word partition!
Theorem 1 It is impossible in the asynchronous network model to implement a...
On Distributed Consistency - Part 2 - Some...
See Also
Part 1 - Introduction and CAP
Part 3 - Network Partitions
Part 4 - Multi Data Center
Part 5 - Multi Writer Eventual Consistency
Part 6 - Consistency Chart
In Part 1 we discussed C-class and A-class behaviors. For A-class, we need to weaken consistency constraints. This does not mean the system need be completely inconsistent, but it does mean we will need to relax the...
March 2010
12 posts
On Distributed Consistency -- Part 1
See also:
Part 2 - Eventual Consistency
Part 3 - Network Partitions
Part 4 - Multi Data Center
Part 5 - Multi Writer Eventual Consistency
Part 6 - Consistency Chart
For distributed databases, consistency models are a topic of huge importance. We’d like to delve a bit deeper on this topic with a series of articles, discussing subjects such as what model is right for a particular use...
MongoDB 1.4 Ready for Production
The MongoDB team is very excited to announce the release of MongoDB 1.4.0. This is the culmination of 3 months of work in the 1.3 branch and has a large number of very important changes.
Many users have been running 1.3 in production, so this release is already very thoroghly vetted both by our regressions systems and by real users.
Some highlights:
Core server enhancements
concurrency...
MongoDB 1.4 Performance
We generally avoid posting benchmarks and suggest people create their own targeting their use cases. However, we have decided to publish a few of our internal micro-benchmarks comparing 1.2 with 1.4RC2 (aka 1.3.5) to show that in almost all cases performance is the same or better (sometime significantly so), even though we’ve added many new features.
The test works by spawning N threads and...
MongoDB Day Austin coming up on Saturday, March 27...
If you’re in the Austin area on March 27, you won’t want to miss MongoDB Day at Cospace in Austin. MongoDB Day Austin will be hosted by GeekAustin, a Slashdot style news site, and sponsored by 10gen.
This conference will have something for anyone interested in using MongoDB, from introductory sessions to more advanced discussions on sharding and MapReduce. Presenters at the...
Are you going to Structure?
GigaOm’s Structure is one of the most interesting conferences in the Bay Area this year. In 2010, we’re excited that Eliot Horowitz from 10gen / MongoDB will be speaking. GigaOm, who were media sponsors at the recently completed NoSQL Live event in Boston, has provided a special discount code for friends of MongoDB to register for the conference at a $100 savings. Hope to see you...
Announcing MongoSF
Please join us for MongoSF, a full-day conference on Friday, April 30 at Bently Reserve in San Francisco.
MongoSF will include sessions on database features, development with MongoDB in a wide range of dynamic languages, in-depth examples of production deployments, and development workshops. In addition to several of the MongoDB developers from 10gen, confirmed speakers include John Nunemaker and...
NoSQL Live Boston Recap
Check out the 10gen blog for a good recap of NoSQL Live Boston.
Should MongoDB Use SQL as a Query Language?
MongoDB does not use SQL as a query language. Why not? This is a very good question and we have discussed it on the project for a long time. There are a few reasons for this.
Given the document-oriented nature of the storage, if we were to do SQL, it really world be a variant, not true SQL. There would be no joins, and we would need extensions to handle the nested constructs involved in JSON...
State of MongoDB March, 2010
Every once in a while, I think its important for us (the core MongoDB team) to give a broad picture of where we think MongoDB is and where we’re hoping to take it. This is useful both as a gut check for us, to give the community some insight into what we’re thinking, and to make sure we’re all on the same page.
MongoDB has made great strides in the last year. The first public...
You need to learn MongoDB
You need to learn MongoDB. We’re offering an informative, hands-on training session to help you do just that. From document-based data modeling to high-performance optimizations, we’ll answer your questions and prepare you for the move to Mongo. Among the topics we’ll cover:
How to use the language drivers, and how they work
How to make the most of atomic updates
...
2d geospatial indexing
We have now added geospatial indexing to the product. Our approach has been to make something simple but fast: 2d only, and effective for common real world use cases such as lat/long location searches.
Would love to get some feedback on features people would like to see, how its working, etc…
Geospatial docs
More notes on 1.3.3 release
MongoDB March Events and NYC Office Hours
Upcoming MongoDB Events
MongoDB will be featured at several events, conferences, and meetups in March, including a webinar on MongoDB internals, Mountain West Ruby Conference in Salt Lake City, NoSQL Live Boston, QCon London, and Cloud Connect in Santa Clara. There’s a MongoDB training session in San Francisco and there will even be a MongoDB Day in Austin! Check the Events page for a...
February 2010
6 posts
Announcing Speakers for NoSQL Live
It’s not too late to register for NoSQL Live in Boston on March 11th. We have an exciting lineup of speakers and panelists who will discuss real use cases for NoSQL in production systems.
Session topics at NoSQL Live will include scaling with NoSQL, NoSQL in the cloud, schema design with document-oriented databases, the evolution of graph data structure from research to production, ...
MongoDB: How it Works Webinar
In October, 10gen hosted a webinar where we heard from 10gen CEO Dwight Merriman and The Business Insider Lead Developer Ian White about the basics of developing applications with MongoDB and about how MongoDB is used in production at TBI.
We’d like to follow up with a webinar focused on how MongoDB works “under the hood.” Please join us on March 8 at 12:30 PM Eastern Time....
MongoDB Survey Results
A couple weeks ago we asked people on Twitter, IRC, and the mailing list to fill out a survey on how they were using MongoDB. About 120 people responded (thanks guys!).
Here is what we gleaned:
Everyone’s a noob
How long people have been using Mongo:
Most people haven’t been using Mongo for very long. Exactly 0% said they’d been using Mongo for a year or more (which makes...
What about Durability?
Note: watch this ticket if interested in this subject and MongoDB.
We get lots of questions about why MongoDB doesn’t have full single server durability, and there are many people that think this is a major problem. We wanted to shed some light on why we haven’t done single server durability, what our suggestions are, and our future plans.
To start, there are some very practical reasons why we...
Practical MongoDB Training with Kyle Banker
10gen is offering day-long MongoDB training sessions in San Francisco and New York City! Kyle Banker, a software engineer at 10gen, will be leading both sessions. Kyle has presented MongoDB in numerous forums, most recently at Chicago Ruby, and is excited to share his expertise. Kyle is preparing several interesting and challenging projects so that attendees can really get their hands...
Hosting Center Update
Update on supported hosting options:
Dreamhost is now offering instant configuration and deployment of MongoDB to DreamHost PS customers
Webfaction and Linode have recently published instructions for installing MongoDB on their respective systems
Check out the Hosting Center for more details. If you’re interested in support from other hosting providers, please let us know which ones...
January 2010
1 post
3 tags
Announcing NoSQL Live from Boston: March 11, 2010
Clear your calendars for NoSQL Live, hosted by 10gen in Boston on March 11th. It’s not your ordinary NoSQL meetup. Rather than introducing attendees to basic functions on the tools out there, NoSQL Live will bring together people using MongoDB and a number of different non-relational databases to discuss real use cases in production systems. The full-day conference will feature panel discussions,...
December 2009
2 posts
4 tags
"Partial Object Updates" will be an Important...
It’s nice that in SQL we can do things like
UPDATE PERSONS SET X = X + 1
We term this a “partial object update”: we updated the value of X without sending a full row update to the server.
Seems like a very simple thing to be discussing, yet some nosql solutions do not support this (others do).
In these new datastores, the average stored object size (whether it be a document,...
NoSQL and the future of cloud databases
news.cnet.com — One of the cloud-related trends that developers have been paying attention to is “NoSQL,” a set of operational-data technologies based on nonrelational technology. According to Dwight Merriman, CEO of 10gen (the commercial team behind the open-source MongoDB project), we’ll see NoSQL complement existing applications for the...
November 2009
4 posts
5 tags
Fast Updates with MongoDB (update-in-place)
One nice feature with MongoDB is that updates can happen “in place” — the database does not have to allocate and write a full new copy of the object.
This can be highly performant for frequent update use cases. For example, incrementing a counter is a highly efficient operation. We need not fetch the document from the server, we can simply send an increment operation...
Webinar recording posted
The recording of the webinar on MongoDB by Dwight Merriman (10gen) & Ian White (Business Insider) is available here: http://vivu.tv/portal/archive.jsp?flow=527-472-7945&id=1256920226675
10gen is looking for a full time Java developer
10gen, which provides commercial support for MongoDB, is hiring a Java developer to work full time on the JVM languages in NYC.
This job entails maintenance and improvement of the Java driver, and also working with the JVM languages like scala and clojure.
If you’re interested, you can send an email to info at 10gen dot com. If you’re really interested, you should submit a patch...
4 tags
Joyent
A prebuilt binary for Joyent (labeled “Solaris64”) is now available on the mongodb.org downloads page.
See http://www.mongodb.org/display/DOCS/Joyent for more information including an example of installation.
October 2009
3 posts
More than 10 Indexes now Supported
The 10 index limit per collection has been raised to 40. This is available in the latest daily build.
Please consider “alpha” for now (like any daily build) but let us know how it works.
Webinar on MongoDB on Oct 30th
We’re doing a webinar on MongoDB on Oct 30, 2009 noon EST. It’ll be an overview of MongoDB & will also have Ian White from Business Insider talking about how they are using MongoDB in production: Details & register at: http://mongodb1.eventbrite.com/
(The webinar is FREE)
We’ve been speaking about MongoDB at physical events like conferences and meetups. But since there’s interest in...
6 tags
Databases Should be Dynamically Typed
Software developers often debate the pros and cons of static versus dynamic typing in programming languages. Yet what about databases?
Of course, static typing is traditional for databases. In a relational database we usual declare our columns and the datatype of each column’s values.
However, we now see in the nosql space what are known as “schemaless” databases. Technically...
September 2009
2 posts
12 tags
Upcoming Conferences for the MongoDB Team
We try to speak about MongoDB at as many conferences and meetups as possible. If you’re interested in learning more about MongoDB or in meeting some of the people who work on it then you should try to make it out to one. Our schedule for the next couple of months is below. If you know of (or are organizing) a conference/meetup where you’d like to hear from us shoot us an email at...
5 tags
Storing Large Objects and Files in MongoDB
Large objects, or “files”, are easily stored in MongoDB. It is no problem to store 100MB videos in the database. For example, MusicNation uses MongoDB to store its videos.
This has a number of advantages over files stored in a file system. Unlike a file system, the database will have no problem dealing with millions of objects. Additionally, we get the power of the database...
August 2009
6 posts
2 tags
1.0 GA Released
The MongoDB team is very happy to announce that we have released MongoDB version 1.0.0.
MongoDB 1.0.0 is production ready for single master, master/slave and replica pair environments. While there are many more features that people want and that we are working on, 1.0 is very stable and the code base has been used in production for over 18 months.
As usual, you can get from here:...
6 tags
MongoDB is Fantastic for Logging
We’re all quite used to having log files on lots of servers, in disparate places. Wouldn’t it be nice to have centralized logs for a production system? Logs that can be queried?
I would encourage everyone to consider using MongoDB for log centralization. It’s a very good fit for this problem for several reasons:
MongoDB inserts can be done asynchronously. One...
2 tags
Using MongoDB for Real-time Analytics
Some MongoDB developers use the database as a way to track real-time performance metrics for their websites (page views, uniques, etc.) Tools like Google Analytics are great but not real-time — sometimes it is useful to build a secondary system that provides basic realtime stats. Using the Mongo upsert and $inc features, we can efficiently solve the problem. When an app server renders a...
Looking for a Ruby Developer
10gen is looking for a Ruby developer to work on the ruby driver, ruby support, and be another MongoDB expert to help out with all the work going into MongoDB right now.
More info here: http://www.10gen.com/jobs
If you’re interested, send an email to info at 10gen dt com, or ping us on irc.
10gen is located in New York
-Eliot
MongoDB 0.9.10 Released
MongoDB 0.9.10 has been released. This release fixes a few minor bugs in 0.9.9 in preperation for 1.0. Please give it a try and let us know if there are any issues.
Notable Changes:
potential crash on os x when using javascript from multiple clients
issue when allocating large objects when a collection is still small
group command that is much faster
$mod operator
Downloads:...