RetroArch/libretro-db
2022-03-15 05:51:20 +01:00
..
lua for loop cleanups - use space after 'for' 2020-08-19 03:06:22 +02:00
.gitignore libretro-db: Ignore compiled binaries 2018-04-14 14:08:28 -04:00
bintree.c Turn this into global constant 2020-09-20 22:47:38 +02:00
bintree.h Header update #1 2017-01-22 13:40:32 +01:00
c_converter_test.sh Clean up white space. 2019-02-03 16:00:50 -08:00
c_converter.c forgot to include the changes for the c_converter to include the metadata in the rdb files 2022-03-15 05:51:20 +01:00
dat_converter Change this back 2016-01-26 08:41:07 +01:00
libretrodb_tool.c (libretro-db) Avoid callocs when possible 2020-06-26 20:24:05 +02:00
libretrodb.c (Mac) More warning fixes 2021-01-26 21:21:51 +01:00
libretrodb.h Header update #1 2017-01-22 13:40:32 +01:00
Makefile libretro-db: hash.c is now lrc_hash.c 2021-03-12 11:47:42 -05:00
query.c Add ctype variants to stdstring and use it in RA 2020-09-27 22:15:32 +02:00
query.h Header update #1 2017-01-22 13:40:32 +01:00
README.md Update libretro-db/README.md 2019-07-18 14:02:17 -07:00
rmsgpack_dom.c Get rid of unused variables 2020-08-04 04:07:42 +02:00
rmsgpack_dom.h Reordre structs, alignment 2020-08-15 18:42:27 +02:00
rmsgpack_test.c Add hint defines to libretro.h 2017-12-11 12:53:47 +01:00
rmsgpack.c C89 buildfix 2021-08-24 22:32:47 +03:00
rmsgpack.h Remove trailing blank lines. 2019-01-17 19:39:38 -08:00

libretrodb

A small read only database Mainly to be used by retroarch

Usage

Files specified later in the chain will override earlier ones if the same key exists multiple times.

  • To list out the content of a db libretrodb_tool <db file> list
  • To create an index libretrodb_tool <db file> create-index <index name> <field name>
  • To find an entry with an index libretrodb_tool <db file> find <index name> <value>

Compiling a single DAT into a single RDB with c_converter

git clone https://github.com/libretro/libretro-super.git
cd libretro-super
./libretro-fetch.sh retroarch
cd retroarch
./configure
cd libretro-db
c_converter "NAME_OF_RDB_FILE.rdb" "NAME_OF_SOURCE_DAT.dat"

Compiling multiple DATs into a single RDB with c_converter

Specify rom.crc as the second parameter to use CRC as the unique fingerprint.

git clone https://github.com/libretro/libretro-super.git
cd libretro-super
./libretro-fetch.sh retroarch
cd retroarch
./configure
cd libretro-db
c_converter "NAME_OF_RDB_FILE.rdb" "rom.crc" "NAME_OF_SOURCE_DAT_1.dat" "NAME_OF_SOURCE_DAT_2.dat" "NAME_OF_SOURCE_DAT_3.dat"

Compiling all RDBs with libretro-build-database.sh

This approach builds and uses the c_converter program to compile the databases

git clone https://github.com/libretro/libretro-super.git
cd libretro-super
./libretro-fetch.sh retroarch
./libretro-build-database.sh

Lua DAT file converter

To convert a dat file use:

dat_converter <db file> <dat file>

If you want to merge multiple dat files you need to run:

dat_converter <db file> <match key> <dat file> ...

for example:

dat_converter snes.rdb rom.crc snes1.dat snes2.dat

Query examples

Some examples of queries you can use with libretrodbtool:

  1. Glob pattern matching Usecase : Search for all games starting with 'Street Fighter' in the 'name' field (glob pattern matching)

libretrodb_tool <db file> find "{'name':glob('Street Fighter*')}"

  1. Combined number matching query Usecase: Search for all games released on October 1995.

libretrodb_tool <db file> find "{'releasemonth':10,'releaseyear':1995}"

  1. Hash matching query Usecase: Search for any game matching a given crc32, in this case Soul Blazer (USA) for the SNES. Also works with serial, md5, and sha1.

libretrodb_tool <db file> find "{'crc':b'31B965DB'}"

  1. Names only search Usecase: Search for all games released on October 1995, wont print checksums, filename or rom size, only the game name.

libretrodb_tool <db file> get-names "{'releasemonth':10,'releaseyear':1995}"

Writing Lua converters

In order to write you own converter you must have a lua file that implements the following functions:

-- this function gets called before the db is created and should validate the
-- arguments and set up the ground for db insertion
function init(...)
	local args = {...}
	local script_name = args[1]
end

-- this is in iterator function. It is called before each insert.
-- the function should return a table for insertion or nil when there are no
-- more records to insert.
function get_value()
	return {
		key = "value", -- will be saved as string
		num = 3, -- will be saved as int
		bin = binary("some string"), -- will be saved as binary
		unum = uint(3), -- will be saved as uint
		some_bool = true, -- will be saved as bool
	}
end