This portal has been discontinued and archived in 2021, and some functionality may no longer work as expected. Please explore
the next generation of this technology
and contact Grigori Fursin, the author and architect of this platform, for more information.
compare_experiments mlperf
ck-action:compare_experiments mlperf (v2.5.0)
License: BSD 3-clause (code) and CC BY-SA 4.0 (data)
Creation date: 2019-03-12
Source: GitHub
cID: 081173242a88bc94:b584cfab2f2ccc60
Don't hesitate to get in touch if you encounter any issues or would like to discuss this community project!
Creation date: 2019-03-12
Source: GitHub
cID: 081173242a88bc94:b584cfab2f2ccc60
Description
- Automation framework: CK
- Workflow: MLPerf benchmarking - common functionality
- Development repository: ck-mlperf
- Source: GitHub
- How to get the stable version via the CK client:
pip install cbench
cb download module:mlperf --version=2.5.0 --all
ck compare_experiments mlperf --help - How to get the development version:
pip install ck
ck pull repo:ck-mlperf
ck compare_experiments mlperf --help
- How to run from Python:
import ck.kernel as ck
r=ck.access({'action':'',
'module_uoa':'',
... See JSON API below ...
})
if r['return']>0: return r
...
- Module description: Validate MLPerf submission against reference
- API Python code: Link
- JSON API:
" Input: { (cids[]) - up to 2 CIDs of entries to compare (interactive by default) (repo_uoa) - experiment repository ('*' by default) (extra_tags) - extra tags to search for CIDs } Output: { return - return code = 0, if successful > 0, if error (error) - error text if return > 0 } "