You are viewing a single comment's thread from:
RE: Building a Blockchain with Go - Persistence and Command Line - Part 3
Hi @tensor, a little bit out of topic since you mention about LevelDB 🙂.
In some of Deep Learning framework I ever try, some of them use LevelDB while the others use HDF5 (not mistaken with HDFS). Do you know what's the key difference is?
Well firstly, LevelDB isn't really the same as HDF5 as one is a database and the other is a structure format. That being said, LevelDB uses LMDB which can kind of be compared with HDF5.
HDF5 requires many system calls to access the data. LMDB on the other hand requires zero system calls per data access instance. LMDB is made to be extremely fast and efficient with that being the primary focus, where as HDF5 has more of an emphasis on structure. Again though, its hard to compare the two since they aren't really the same thing.
Hmm...so HDF5 is suitable for storing a bunch of data with a lot of different structure while LMDB more like when performance is really important, plus if you need embeddable database since LMDB doesn't require system calls 🤔