Compare commits
No commits in common. "73d7687359b4d8f1b5e8351f6700fff8be0a6b4e" and "50ff178a0cfd4979c68885cd6249c9a2820ac517" have entirely different histories.
73d7687359
...
50ff178a0c
3 changed files with 10 additions and 27 deletions
1
.gitignore
vendored
1
.gitignore
vendored
|
|
@ -1,4 +1,3 @@
|
||||||
pyerrors_corrlib.egg-info
|
pyerrors_corrlib.egg-info
|
||||||
__pycache__
|
__pycache__
|
||||||
*.egg-info
|
*.egg-info
|
||||||
test.ipynb
|
|
||||||
|
|
|
||||||
|
|
@ -5,12 +5,3 @@ This is done in a reproducible way using `datalad`.
|
||||||
In principle, a dataset is created, that is automatically administered by the backlogger, in which data from differnt projects are held together.
|
In principle, a dataset is created, that is automatically administered by the backlogger, in which data from differnt projects are held together.
|
||||||
Everything is catalogued by a searchable SQL database, which holds the paths to the respective measurements.
|
Everything is catalogued by a searchable SQL database, which holds the paths to the respective measurements.
|
||||||
The original projects can be linked to the dataset and the data may be imported using wrapper functions around the read methonds of pyerrors.
|
The original projects can be linked to the dataset and the data may be imported using wrapper functions around the read methonds of pyerrors.
|
||||||
|
|
||||||
We work with the following nomenclature in this project:
|
|
||||||
- Measurement
|
|
||||||
A setis of Observables, including the appropriate metadata.
|
|
||||||
- Project
|
|
||||||
A series of measurements that was done by one person as part of their research.
|
|
||||||
- Record
|
|
||||||
An entry of a single Correlator in the database of the backlogger.
|
|
||||||
-
|
|
||||||
25
TODO.md
25
TODO.md
|
|
@ -1,21 +1,14 @@
|
||||||
# TODO
|
# TODO
|
||||||
|
|
||||||
## Features
|
## Features
|
||||||
- [ ] implement import of non-datalad projects
|
- implement import of non-datalad projects
|
||||||
- [ ] implement a way to use another backlog repo as a project
|
- implement a way to use another backlog repo as a project
|
||||||
- [ ] make cache deadlock resistent (no read while writing)
|
|
||||||
- [ ] find a way to convey the mathematical structure of what EXACTLY is the form of the correlator in a specific project
|
- find a way to convey the mathematical structure of what EXACTLY is the form of the correlator in a specific project
|
||||||
- [ ] this could e.g. be done along the lines of mandatory documentation
|
- this could e.g. be done along the lines of mandatory documentation
|
||||||
- [ ] keep better track of the versions of the code, that was used for a specific measurement.
|
- keep better track of the versions of the code, that was used for a specific measurement.
|
||||||
- [ ] maybe let this be an input in the project file?
|
- maybe let this be an input in the project file?
|
||||||
- [ ] git repo and commit hash/version tag
|
- git repo and commit hash/version tag
|
||||||
- [ ] implement a code table?
|
|
||||||
- [ ] parallel processing of measurements
|
|
||||||
- [ ] extra SQL table for ensembles with UUID and aliases
|
|
||||||
## Bugfixes
|
## Bugfixes
|
||||||
- [ ] revisit the reimport function for single files
|
- [ ] revisit the reimport function for single files
|
||||||
- [ ] drop record needs to look if no records are left in a json file.
|
|
||||||
|
|
||||||
## Rough Ideas
|
|
||||||
- [ ] multitable could provide a high speed implementation of an HDF5 based format
|
|
||||||
- [ ] implement also a way to include compiled binaries in the archives.
|
|
||||||
|
|
|
||||||
Loading…
Add table
Add a link
Reference in a new issue