update TODO and README

.gitignore

@@ -1,3 +1,4 @@
 pyerrors_corrlib.egg-info
 __pycache__
 *.egg-info
+test.ipynb

README.md

@@ -5,3 +5,12 @@ This is done in a reproducible way using `datalad`.
 In principle, a dataset is created, that is automatically administered by the backlogger, in which data from differnt projects are held together.
 Everything is catalogued by a searchable SQL database, which holds the paths to the respective measurements.
 The original projects can be linked to the dataset and the data may be imported using wrapper functions around the read methonds of pyerrors.
+
+We work with the following nomenclature in this project:
+- Measurement
+    A setis of Observables, including the appropriate metadata.
+- Project
+    A series of measurements that was done by one person as part of their research.
+- Record
+    An entry of a single Correlator in the database of the backlogger.
+- 

TODO.md

@@ -1,14 +1,21 @@
 # TODO
 
 ## Features
-- implement import of non-datalad projects
+- [ ] implement import of non-datalad projects
-- implement a way to use another backlog repo as a project
+- [ ] implement a way to use another backlog repo as a project
-
+- [ ] make cache deadlock resistent (no read while writing)
-- find a way to convey the mathematical structure of what EXACTLY is the form of the correlator in a specific project
+- [ ] find a way to convey the mathematical structure of what EXACTLY is the form of the correlator in a specific project
-    - this could e.g. be done along the lines of mandatory documentation
+    - [ ] this could e.g. be done along the lines of mandatory documentation
-- keep better track of the versions of the code, that was used for a specific measurement.
+- [ ] keep better track of the versions of the code, that was used for a specific measurement.
-    - maybe let this be an input in the project file?
+    - [ ] maybe let this be an input in the project file?
-    - git repo and commit hash/version tag
+    - [ ] git repo and commit hash/version tag
-
+    - [ ] implement a code table?
+- [ ] parallel processing of measurements
+- [ ] extra SQL table for ensembles with UUID and aliases
 ## Bugfixes
 - [ ] revisit the reimport function for single files
+- [ ] drop record needs to look if no records are left in a json file.
+
+## Rough Ideas
+- [ ] multitable could provide a high speed implementation of an HDF5 based format
+- [ ] implement also a way to include compiled binaries in the archives.