[cfe-dev] Announcing Crange

[Anurag]

On Sat, May 10, 2014 at 1:18 AM, Renato Golin <renato.golin at linaro.org> wrote:
> I don't expect the db to be the bottleneck here. If you plan your
> table reasonably well (and this usage is *very* simple for a
> relational database), queries should return results in milliseconds
> for almost all queries, including inserts and updates.
>
> However, during the parse, because you'll be listing all
> relationships, if you insert one at a time, preparing the queries will
> amount to a significant portion of the run-time. There are ways of
> inserting blocks of data on the same query that you might consider, or
> even creating a CSV and importing (MySQL could do that, not sure about
> SQLite).

This is how I'm inserting nodes into the SQLite db too. I collate all
the node metadata into a python list and run cursor.executemany().
Bulk inserts executed inside a transaction are very fast in SQLite.

Anurag