Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
OrcaSong
Manage
Activity
Members
Labels
Plan
Issues
Issue boards
Milestones
Wiki
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Deploy
Releases
Package Registry
Container Registry
Model registry
Operate
Environments
Terraform modules
Monitor
Incidents
Analyze
Value stream analytics
Contributor analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
Machine Learning
OrcaSong
Commits
7e9d4fe3
Commit
7e9d4fe3
authored
3 years ago
by
Stefan Reck
Browse files
Options
Downloads
Patches
Plain Diff
docs
parent
608ac19b
No related branches found
No related tags found
1 merge request
!20
Parser
Changes
4
Pipelines
1
Hide whitespace changes
Inline
Side-by-side
Showing
4 changed files
docs/getting_started.rst
+9
-3
9 additions, 3 deletions
docs/getting_started.rst
docs/orcasong.rst
+1
-1
1 addition, 1 deletion
docs/orcasong.rst
docs/tools.rst
+6
-3
6 additions, 3 deletions
docs/tools.rst
examples/orcasong_example.toml
+5
-2
5 additions, 2 deletions
examples/orcasong_example.toml
with
21 additions
and
9 deletions
docs/getting_started.rst
+
9
−
3
View file @
7e9d4fe3
...
...
@@ -12,7 +12,7 @@ Step 1: From root aanet files to h5 aanet files
Convert offline files (aka aanet files) from root format to h5 format using
the 'h5extract' command of km3pipe like so::
h5extract
filenam
e.root
h5extract
aanet_fil
e.root
.. note::
This has to be done only once for each file. Check if somebody did this
...
...
@@ -23,8 +23,14 @@ the 'h5extract' command of km3pipe like so::
Step 2: From h5 aanet files to h5 DL files
------------------------------------------
Produce DL h5 files from the aanet h5 files using OrcaSong.
You can either produce images or graphs. See :ref:`orcasong_page` for
instructions on how to do this.
You can either produce images or graphs.
If you have an orcasong config file, you can use it via the command line like this::
orcasong run aanet_file.h5 orcasong_config.toml --detx_file detector.detx
Alternatively, you can use the python frontend of orcasong.
See :ref:`orcasong_page` for instructions on how to do this.
The resulting DL h5 files can already be used as input for networks!
...
...
This diff is collapsed.
Click to expand it.
docs/orcasong.rst
+
1
−
1
View file @
7e9d4fe3
...
...
@@ -3,7 +3,7 @@
Producing DL h5 files from aanet h5 files
=========================================
Describes how to use OrcaSong to produce h5 files for Deep Learning
Describes how to use OrcaSong
in python
to produce h5 files for Deep Learning
from aanet h5 files. These files can contain either images (for convolutional
networks), or graphs (for Graph networks).
...
...
This diff is collapsed.
Click to expand it.
docs/tools.rst
+
6
−
3
View file @
7e9d4fe3
...
...
@@ -37,7 +37,7 @@ km3pipe. The input can also be a txt file like from make_data_split.
Can be used via the commandline like so::
concatenate --help
orcasong
concatenate --help
or import as:
...
...
@@ -58,7 +58,7 @@ Shuffle an h5 file using km3pipe.
Can be used via the commandline like so::
h5shuffle --help
orcasong
h5shuffle --help
or import function for general postprocessing:
...
...
@@ -69,4 +69,7 @@ or import function for general postprocessing:
postproc_file(output_filepath_concat)
Theres also a faster (beta) version available called h5shuffle2.
Theres also a faster (beta) version available called h5shuffle2::
orcasong h5shuffle2 --help
This diff is collapsed.
Click to expand it.
examples/orcasong_example.toml
+
5
−
2
View file @
7e9d4fe3
# This is an example config for running orcasong. It's not intended
# to be used for actual large-scale productions.
# the mode to run orcasong in; either 'graph' or 'image'
mode
=
"graph"
# arguments for FileGraph or FileBinner (see orcasong.core)
...
...
@@ -6,8 +9,8 @@ time_window = [-100, 5000]
# can also give the arguments of orcasong.core.BaseProcessor,
# which are shared between modes
chunksize
=
16
# built-in extractor function to use
# built-in extractor function to use
(see orcasong.from_toml.EXTRACTORS)
extractor
=
"neutrino_mc"
[extractor_config]
#
optional
arguments for the extractor function can go here. None in this case.
# arguments for
setting up
the extractor function can go here. None in this case.
This diff is collapsed.
Click to expand it.
Preview
0%
Loading
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment