Check a prototype of 2nd version of this platform being developed by cKnowledge.org in collaboration with MLCommons.

Universal experiment entries

module:experiment (v3.0.0)
Share
License: BSD 3-clause (code) and CC BY-SA 4.0 (data)
Creation date: 2014-12-06
Source: GitHub
cID: 032630d041b4fd8a:bc0409fb61f0aa82

Don't hesitate to get in touch if you encounter any issues or would like to discuss this community project!
Please report if this CK component works: 1 ▲ or fails: 0 ▲
Sign up to be notified when artifacts are shared or updated!

Description  

This is our attempt to share automation actions from scientific research projects as unified Python modules with a common CLI and Python API to help researchers and practitioners reuse best practices. Our on-going project is to make the onboarding process as simple as possible via this platform. Please check this CK white paper and don't hesitate to contact us if you have suggestions or feedback!
  • Automation framework: CK
  • Development repository: ck-ml
  • Source: GitHub
  • How to get the stable version from this portal via the CK client:
    pip install cbench
    cb download module:experiment --version=3.0.0 --all
    ck help experiment
  • How to get the development version:
    pip install ck
    ck pull repo:ck-ml
    ck help experiment
  • CK automation actions (CLI with the Python CK API and JSON IO):
    • ck add experiment - process and add experiment (API)
    • ck browse experiment - open browser and view experiment details (API)
    • ck convert_table_to_csv experiment - Convert experiment table to CSV (API)
    • ck crowdsource experiment - crowdsource experiments (API)
    • ck delete_points experiment - delete multiple points from multiple entries (API)
    • ck filter experiment - filter / pre-process data (API)
    • ck get experiment - get points from multiple entries (API)
    • ck get_all_meta experiment - get all meta information from all entries (API)
    • ck get_and_cache_results experiment - get and cache experimental results (API)
    • ck get_log_path experiment - get log path (API)
    • ck get_unique_keys_from_list experiment - get unique keys from list of experiments (API)
    • ck html_viewer experiment - view experiment as html (API)
    • ck list_points experiment - list all points in a given entry (API)
    • ck load_pipeline experiment - load pipeline info (id and dictionary contents) (API)
    • ck load_point experiment - load all info about a given point (and subpoint) (API)
    • ck log experiment - log experiments (API)
    • ck multi_stat_analysis experiment - perform statistical analysis (with multiple points at the same time) (API)
    • ck pack experiment - pack experiments (API)
    • ck prepare_html_selector experiment - prepare HTML selector (API)
    • ck prepare_selector experiment - prepare first level of experiments with pruning (API)
    • ck replay experiment - replay experiment == the same as reproduce (API)
    • ck reproduce experiment - reproduce/replay/rerun a given experiment (API)
    • ck rerun experiment - rerun experiment == the same as reproduce (API)
    • ck sort_table experiment - sort table, substitute index with a sequence (html) (API)
    • ck stat_analysis experiment - process multiple experimental results and perform statistial analysis (including expected values) (API)
    • ck substitute_x_with_loop experiment - substitute x axis in table with a sequence (API)

Dependencies    

Style 1   Style 2  

Versions  

Files  

Comments  

Please log in to add your comments!
If you notice any inapropriate content that should not be here, please report us as soon as possible and we will try to remove it within 48 hours!