Skip to content

ls: Fail nicer if duct logs are in git annex, not fetched #436

Description

@asmacdo
✘  ~/datasets/ds000007-mriqc   base  pwd
/home/austin/datasets/ds000007-mriqc
 ~/datasets/ds000007-mriqc   base  git remote -v
origin	https://cerebra.fz-juelich.de/f.hoffstaedter/ds000007-mriqc (fetch)
origin	https://cerebra.fz-juelich.de/f.hoffstaedter/ds000007-mriqc (push)
 ~/datasets/ds000007-mriqc   base  con-duct ls logs/duct/*         
2026-05-29T12:11:19-0500 [INFO    ] con-duct: No .env files found
Traceback (most recent call last):
  File "/home/austin/.local/bin/con-duct", line 6, in <module>
    sys.exit(main())
             ~~~~^^
  File "/home/austin/.local/lib/python3.13/site-packages/con_duct/cli.py", line 547, in main
    sys.exit(execute(args))
             ~~~~~~~^^^^^^
  File "/home/austin/.local/lib/python3.13/site-packages/con_duct/cli.py", line 473, in execute
    result = args.func(args)
  File "/home/austin/.local/lib/python3.13/site-packages/con_duct/ls.py", line 233, in ls
    run_data_raw = load_duct_runs(info_files, args.eval_filter)
  File "/home/austin/.local/lib/python3.13/site-packages/con_duct/ls.py", line 76, in load_duct_runs
    with open(info_file) as file:
         ~~~~^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: 'logs/duct/mriqc-group-stats_2025.10.10T03.47.32-2504301_info.json'

Error resolves if you datalad get them.

 ✘  ~/datasets/ds000007-mriqc   base  datalad get logs/duct/
get(ok): logs/duct/mriqc-group-stats_2025.10.10T03.47.32-2504301_info.json (file) [from origin...]             
get(ok): logs/duct/mriqc-group-stats_2025.10.10T03.47.32-2504301_stderr (file) [from origin...]                
get(ok): logs/duct/mriqc-group-stats_2025.10.10T03.47.32-2504301_stdout (file) [from origin...]
get(ok): logs/duct/mriqc-group-stats_2025.10.10T03.47.32-2504301_usage.json (file) [from origin...]
get(ok): logs/duct/mriqc-group-stats_2025.10.10T04.03.42-2528807_info.json (file) [from origin...]
get(ok): logs/duct/mriqc-group-stats_2025.10.10T04.03.42-2528807_stderr (file) [from origin...]
get(ok): logs/duct/mriqc-group-stats_2025.10.10T04.03.42-2528807_stdout (file) [from origin...]
get(ok): logs/duct/mriqc-group-stats_2025.10.10T04.03.42-2528807_usage.json (file) [from origin...]
get(ok): logs/duct/sub-01_2025.10.10T00.36.37-3899234_info.json (file) [from origin...]
get(ok): logs/duct/sub-01_2025.10.10T00.36.37-3899234_stderr (file) [from origin...]
  [78 similar messages have been suppressed; disable with datalad.ui.suppress-similar-results=off]
get(ok): logs/duct (directory)
action summary:
  get (ok: 89)
 ~/datasets/ds000007-mriqc   base  con-duct ls logs/duct/*
2026-05-29T12:13:02-0500 [INFO    ] con-duct: No .env files found
PREFIX                                 COMMAND                               EXIT_CODE WALL_CLOCK_TIME PEAK_RSS
logs/duct/mriqc-group-stats_2025.10... singularity exec -W /tmp/singtmp.Z... 0         7.088 sec       327.4 MB
logs/duct/mriqc-group-stats_2025.10... singularity exec -W /tmp/singtmp.j... 0         2.490 sec       141.1 MB
logs/duct/sub-01_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.k... 0         2080.558 sec    8.6 GB  
logs/duct/sub-02_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.Z... 0         1975.682 sec    7.1 GB  
logs/duct/sub-03_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.C... 0         2216.349 sec    7.1 GB  
logs/duct/sub-04_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.P... 0         2204.206 sec    7.1 GB  
logs/duct/sub-05_2025.10.10T01.19.4... singularity exec -W /tmp/singtmp.N... 0         1931.617 sec    7.1 GB  
logs/duct/sub-06_2025.10.10T00.36.4... singularity exec -W /tmp/singtmp.Z... 0         1991.743 sec    7.1 GB  
logs/duct/sub-07_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.n... 0         2586.044 sec    7.1 GB  
logs/duct/sub-08_2025.10.10T00.36.4... singularity exec -W /tmp/singtmp.w... 0         2084.968 sec    7.1 GB  
logs/duct/sub-09_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.r... 0         1597.623 sec    7.1 GB  
logs/duct/sub-10_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.X... 0         2224.364 sec    7.1 GB  
logs/duct/sub-11_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.M... 0         2003.605 sec    10.9 GB 
logs/duct/sub-12_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.y... 0         2010.894 sec    7.1 GB  
logs/duct/sub-13_2025.10.10T00.36.2... singularity exec -W /tmp/singtmp.l... 0         2118.546 sec    7.2 GB  
logs/duct/sub-14_2025.10.10T00.37.1... singularity exec -W /tmp/singtmp.c... 0         2610.599 sec    7.1 GB  
logs/duct/sub-15_2025.10.10T00.36.2... singularity exec -W /tmp/singtmp.Y... 0         1998.117 sec    7.1 GB  
logs/duct/sub-16_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.i... 0         2170.166 sec    7.1 GB  
logs/duct/sub-17_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.o... 0         2230.344 sec    7.1 GB  
logs/duct/sub-18_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.W... 0         1897.638 sec    7.1 GB  
logs/duct/sub-19_2025.10.10T00.36.3... singularity exec -W /tmp/singtmp.3... 0         2234.384 sec    7.1 GB  
logs/duct/sub-20_2025.10.10T00.36.2... singularity exec -W /tmp/singtmp.B... 0         2216.319 sec    7.1 GB  
 ~/datasets/ds000007-mriqc   base  

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions