New Real Time Battle

Which SQL database engines will be used?

Asked by Rick Stovall

Given the amount of data NRTB will generate, an SQL database engine will go a long way towards simplifying development and testing. Whatever we use, I'd like to keep it open source, fairly lightweight and easily available. Two obvious options are MySQL and SQLite.

* MySQL is a bit heavier, but is completely thread-safe and allows simpler ad-hoc reporting and analysis;

* SQLite is very fast, but less easy to work with independently and some care should be taken in a multi-threaded environment.

There may be other pros and cons, as well as other contenders I've not mentioned. What do you think we should use?

Question information

Language:
English Edit question
Status:
Solved
For:
New Real Time Battle Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:
Whiteboard:
Resolved.
Revision history for this message
George Jordan (gsjordanc) said : 		#1

In order, maybe, to take advantage of the pros of both create a data buffer (data holder queue) using SQLite and then have it feed the more permanent data storage/query area using MySQL?

MySQL would be the query db for downstream processes, while SQLite would be the queued data from the upstream processes.

Revision history for this message
Launchpad Janitor (janitor) said : 		#2

This question was expired because it remained in the 'Open' state without activity for the last 15 days.

Revision history for this message
Rick Stovall (fpstovall) said : 		#3

The question was closed on a timeout... reopening.

Revision history for this message
Rick Stovall (fpstovall) said : 		#4

Let me see if I understand you correctly, Geo. We would use SQLite to buffer or stage the data as it comes out of the simulation engine, and the push it from there to the databroker later. Is that what you are proposing?

It would allow using SQL queries to manage the local transmission cache (and other data as needed)... might be useful.

Revision history for this message
Launchpad Janitor (janitor) said : 		#5

This question was expired because it remained in the 'Open' state without activity for the last 15 days.

Revision history for this message
Rick Stovall (fpstovall) said : 		#6

For the alpha phase, we'll do the following:

   * Data Broker will use MySQL as the database engine.
   * We'll consider SQLite for data caching, configuration data management, etc for the other modules.

Revision history for this message
Rick Stovall (fpstovall) said : 		#7

Use these database engines.
FAQ #1072: “Alpha Development FAQ”.