Compare commits
No commits in common. "73d7687359b4d8f1b5e8351f6700fff8be0a6b4e" and "50ff178a0cfd4979c68885cd6249c9a2820ac517" have entirely different histories.
73d7687359
...
50ff178a0c
3 changed files with 10 additions and 27 deletions
3
.gitignore
vendored
3
.gitignore
vendored
|
|
@ -1,4 +1,3 @@
|
|||
pyerrors_corrlib.egg-info
|
||||
__pycache__
|
||||
*.egg-info
|
||||
test.ipynb
|
||||
*.egg-info
|
||||
|
|
@ -5,12 +5,3 @@ This is done in a reproducible way using `datalad`.
|
|||
In principle, a dataset is created, that is automatically administered by the backlogger, in which data from differnt projects are held together.
|
||||
Everything is catalogued by a searchable SQL database, which holds the paths to the respective measurements.
|
||||
The original projects can be linked to the dataset and the data may be imported using wrapper functions around the read methonds of pyerrors.
|
||||
|
||||
We work with the following nomenclature in this project:
|
||||
- Measurement
|
||||
A setis of Observables, including the appropriate metadata.
|
||||
- Project
|
||||
A series of measurements that was done by one person as part of their research.
|
||||
- Record
|
||||
An entry of a single Correlator in the database of the backlogger.
|
||||
-
|
||||
25
TODO.md
25
TODO.md
|
|
@ -1,21 +1,14 @@
|
|||
# TODO
|
||||
|
||||
## Features
|
||||
- [ ] implement import of non-datalad projects
|
||||
- [ ] implement a way to use another backlog repo as a project
|
||||
- [ ] make cache deadlock resistent (no read while writing)
|
||||
- [ ] find a way to convey the mathematical structure of what EXACTLY is the form of the correlator in a specific project
|
||||
- [ ] this could e.g. be done along the lines of mandatory documentation
|
||||
- [ ] keep better track of the versions of the code, that was used for a specific measurement.
|
||||
- [ ] maybe let this be an input in the project file?
|
||||
- [ ] git repo and commit hash/version tag
|
||||
- [ ] implement a code table?
|
||||
- [ ] parallel processing of measurements
|
||||
- [ ] extra SQL table for ensembles with UUID and aliases
|
||||
- implement import of non-datalad projects
|
||||
- implement a way to use another backlog repo as a project
|
||||
|
||||
- find a way to convey the mathematical structure of what EXACTLY is the form of the correlator in a specific project
|
||||
- this could e.g. be done along the lines of mandatory documentation
|
||||
- keep better track of the versions of the code, that was used for a specific measurement.
|
||||
- maybe let this be an input in the project file?
|
||||
- git repo and commit hash/version tag
|
||||
|
||||
## Bugfixes
|
||||
- [ ] revisit the reimport function for single files
|
||||
- [ ] drop record needs to look if no records are left in a json file.
|
||||
|
||||
## Rough Ideas
|
||||
- [ ] multitable could provide a high speed implementation of an HDF5 based format
|
||||
- [ ] implement also a way to include compiled binaries in the archives.
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue