Skip to content

Get images Runner revision #429

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
sfarrens merged 18 commits into from
Jul 30, 2021
Merged

Get images Runner revision #429

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
13d7d66
get_images in revision
martinkilbinger Jul 19, 2021
8bd6537
get_images revision cont
martinkilbinger Jul 20, 2021
8eb4b75
job_sp : temp change
martinkilbinger Jul 20, 2021
a4ccfa0
get_images works for vos
martinkilbinger Jul 20, 2021
25b32b5
Merge branch 'get_images_rev' of github.com:martinkilbinger/shapepipe…
martinkilbinger Jul 20, 2021
fe08032
config get exp symlink get_images_runner
martinkilbinger Jul 20, 2021
f87f4b1
removed get_images_runner2
martinkilbinger Jul 20, 2021
3cba3a0
fixed uncomp config
martinkilbinger Jul 20, 2021
fbfaec3
job_sp script back to original
martinkilbinger Jul 20, 2021
dc93d5d
passing tests
martinkilbinger Jul 20, 2021
94bfea9
typo fixed in merge_final_cat python script
martinkilbinger Jul 21, 2021
15b5be3
Merge remote-tracking branch 'upstream/develop' into get_images_rev
martinkilbinger Jul 23, 2021
cef0062
f-string in script
martinkilbinger Jul 30, 2021
3875d81
comment -> str
martinkilbinger Jul 30, 2021
845c4c0
comment -> str
martinkilbinger Jul 30, 2021
73afab7
comments: string -> str
martinkilbinger Jul 30, 2021
bb21721
Merge branch 'get_images_rev' of github.com:martinkilbinger/shapepipe…
martinkilbinger Jul 30, 2021
0aca5cf
i -> idx in loops
martinkilbinger Jul 30, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion example/cfis/config_exp_SpMh.ini
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,7 @@ TIMEOUT = 96:00:00

[SPLIT_EXP_RUNNER]

INPUT_DIR = last:get_images_runner2
INPUT_DIR = $SP_RUN/output/run_sp_Gie:get_images_runner

# Matches compressed single-exposure files
FILE_EXT = .fitsfz, .fitsfz, .fitsfz
Expand Down
4 changes: 2 additions & 2 deletions example/cfis/config_get_exp_symlink.ini
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ RUN_DATETIME = True
[EXECUTION]

# Module name, single string or comma-separated list of valid module runner names
MODULE = get_images_runner2
MODULE = get_images_runner

# Parallel processing mode, SMP or MPI
MODE = SMP
Expand Down Expand Up @@ -51,7 +51,7 @@ TIMEOUT = 96:00:00


## Module options
[GET_IMAGES_RUNNER2]
[GET_IMAGES_RUNNER]

FILE_PATTERN = exp_numbers

Expand Down
4 changes: 2 additions & 2 deletions example/cfis/config_get_exp_vos.ini
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ RUN_DATETIME = True
[EXECUTION]

# Module name, single string or comma-separated list of valid module runner names
MODULE = get_images_runner2
MODULE = get_images_runner

# Parallel processing mode, SMP or MPI
MODE = SMP
Expand Down Expand Up @@ -51,7 +51,7 @@ TIMEOUT = 96:00:00


## Module options
[GET_IMAGES_RUNNER2]
[GET_IMAGES_RUNNER]

FILE_PATTERN = exp_numbers

Expand Down
4 changes: 2 additions & 2 deletions example/cfis/config_get_tiles_symlink.ini
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -85,8 +85,8 @@ INPUT_NUMBERING = \d{3}\.\d{3}
OUTPUT_FILE_PATTERN = CFIS_image-, CFIS_weight-

# Copy/download method, one in 'vos', 'symlink'
COPY = symlink
RETRIEVE = symlink

# Copy command options, optional.
# -L: follow links
COPY_OPTIONS = -L
RETRIEVE_OPTIONS = -L
4 changes: 2 additions & 2 deletions example/cfis/config_get_tiles_vos.ini
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -87,7 +87,7 @@ INPUT_NUMBERING = \d{3}\.\d{3}
OUTPUT_FILE_PATTERN = CFIS_image-, CFIS_weight-

# Copy/download method, one in 'vos', 'symlink'
COPY = vos
RETRIEVE = vos

# Copy command options, optional
COPY_OPTIONS = --certfile=$VM_HOME/.ssl/cadcproxy.pem
RETRIEVE_OPTIONS = --certfile=$VM_HOME/.ssl/cadcproxy.pem
2 changes: 1 addition & 1 deletion example/cfis/config_tile_Ma.ini
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -54,7 +54,7 @@ TIMEOUT = 96:00:00
[MASK_RUNNER]

# Input directory, containing input files, single string or list of names
INPUT_DIR = last:get_images_runner, last:uncompress_fits_image_runner
INPUT_DIR = $SP_RUN/output/run_sp_Git:get_images_runner, last:uncompress_fits_image_runner

# NUMBERING_SCHEME (optional) string with numbering pattern for input files
NUMBERING_SCHEME = -000-000
Expand Down
4 changes: 2 additions & 2 deletions example/cfis/config_tile_MaSxMiViSmVi.ini
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ LOG_NAME = log_sp
RUN_LOG_NAME = log_run_sp

# Input directory, containing input files, single string or list of names
INPUT_DIR = last:get_images_runner, last:uncompress_fits_image_runner
INPUT_DIR = $SP_RUN/output/run_sp_Git:get_images_runner, last:uncompress_fits_image_runner

# Output directory
OUTPUT_DIR = $SP_RUN/output
Expand Down Expand Up @@ -81,7 +81,7 @@ SUFFIX = pipeline

[SEXTRACTOR_RUNNER]

INPUT_DIR = last:get_images_runner, last:uncompress_fits_image_runner, last:mask_runner
INPUT_DIR = $SP_RUN/output/run_sp_Git:get_images_runner, last:uncompress_fits_image_runner, last:mask_runner

FILE_PATTERN = CFIS_image, CFIS_weight, pipeline_flag

Expand Down
4 changes: 2 additions & 2 deletions example/cfis/config_tile_MaSxPiViSmVi.ini
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ LOG_NAME = log_sp
RUN_LOG_NAME = log_run_sp

# Input directory, containing input files, single string or list of names
INPUT_DIR = last:get_images_runner, last:uncompress_fits_image_runner
INPUT_DIR = $SP_RUN/output/run_sp_Git:get_images_runner, last:uncompress_fits_image_runner

# Output directory
OUTPUT_DIR = $SP_RUN/output
Expand Down Expand Up @@ -81,7 +81,7 @@ SUFFIX = pipeline

[SEXTRACTOR_RUNNER]

INPUT_DIR = last:get_images_runner, last:uncompress_fits_image_runner, last:mask_runner
INPUT_DIR = $SP_RUN/output/run_sp_Git:get_images_runner, last:uncompress_fits_image_runner, last:mask_runner

FILE_PATTERN = CFIS_image, CFIS_weight, pipeline_flag

Expand Down
96 changes: 0 additions & 96 deletions example/cfis/config_tile_Ng1u.ini
View file
Open in desktop

This file was deleted.

96 changes: 0 additions & 96 deletions example/cfis/config_tile_Ng2u.ini
View file
Open in desktop

This file was deleted.

Loading