Skip to content

GitLab

  • Menu
Projects Groups Snippets
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
  • ketos ketos
  • Project information
    • Project information
    • Activity
    • Labels
    • Planning hierarchy
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 27
    • Issues 27
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • public_projects
  • ketosketos
  • Issues
  • #163

Closed
Open
Created Feb 09, 2022 by Sadman Sakib@sadmanDeveloper

updating create_database function to read data from tar files

We could update the create_database method to incorporate functionalities to read and create the database from a tar file. We can make use of python's tarfile package (https://docs.python.org/3/library/tarfile.html).

For reference: I modified the current (ketos version 2.4.1) create_database function to add this functionality to the function. A working example of the code which I implemented for the HALLO DFO dataset can be found be here: https://github.com/coastal-science/detectors_and_classifiers/blob/main/KW_detector_multiclass/code/create_db/prepare_dfo_db.ipynb

This implementation extracts one audio file at a time and then use typical functions to create the database and then removes that extracted file and move onto the next file.

We could either use this modified create_database() function as a separate function and maybe name it something like create_database_from_tar(). Else, we could also use a flag-like argument which can be used inside the function as a condition if the user wants to use a tar file to create an audio file.

Edited Feb 09, 2022 by Sadman Sakib
To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information
Assignee
Assign to
Time tracking