Download data

Using astroquery

Download observations from MAST using astroquery for a part of an HST program

TL;DR: If you want to download the data from the two visits, execute the scripton the PACMAN GitHub.

This tutorial is based on the following Jupyter Notebooks on the STSci GitHub: (1) and (2).

Here we will download HST data using astroquery.

A script example on how to do is can be found on the PACMAN GitHub. In this tutorial, we are going to have a look at this script using a Jupyter Notebook.

It is recommended to run this script or jupyter notebook in a new directory. The fits files will be saved there and this directory will then be used as the “data directory”. More on the data directory here (in the context of the pcf) and here.

In this example, we are going to analyze just two visits (with index 5 and 6) taken in the middle of the GO13021 program for simplicity:

Dates (YYYY-MM-DD): 2013-03-13 and 2013-03-15.

If the user has already downloaded all 15 visits in GO13021, he or she can choose: which_visits = [5,6] in the pcf (see the pcf page about this parameter).

Alternative methods on how to download HST data can be found here: https://pacmandocs.readthedocs.io/en/latest/download_data.html

Let’s first import some necessary packages.

[1]:

from astropy.time import Time
import os
from astroquery.mast import Observations

Set start and end time of the observations in MJD

We are going to first find out the start and end times of the observations to define the files we want to download. Looking at the Visit Status Report for program 13021 we can see the times in UT are: Note that STSci is using a different indexing for the visits! PACMAN uses a temporally sorted indexing scheme.

From the website:

START Mar 13, 2013 12:34:53

END Mar 13, 2013 18:17:34

START Mar 15, 2013 02:52:08

END Mar 15, 2013 08:34:55

[4]:

t_obs_utc = ['2013-03-13T12:34:53', '2013-03-15T08:34:55'] # very start and end of the two visits
t_obs = Time(t_obs_utc, format='isot', scale='utc')

[5]:

t_obs

[5]:

<Time object: scale='utc' format='isot' value=['2013-03-13T12:34:53.000' '2013-03-15T08:34:55.000']>

[6]:

t_min_obs =  t_obs.mjd[0] - 0.0001
t_max_obs =  t_obs.mjd[1] + 0.0001

The proposal ID is 13021 and we are just interested in the data taken with HST WFC3.

[7]:

proposal_obs = Observations.query_criteria(proposal_id=13021, instrument_name='WFC3/IR', project='HST')
print("Number of observations:",len(proposal_obs))
print(proposal_obs)

Number of observations: 1115
dataproduct_type calib_level obs_collection ... intentType  obsid     objID
---------------- ----------- -------------- ... ---------- -------- ---------
        spectrum           3            HST ...    science 23901558 139211258
        spectrum           3            HST ...    science 23901554 139211259
        spectrum           3            HST ...    science 23901557 139211260
        spectrum           3            HST ...    science 23901739 139211261
        spectrum           3            HST ...    science 23901737 139211268
        spectrum           3            HST ...    science 23901747 139211277
        spectrum           3            HST ...    science 23901722 139211708
             ...         ...            ... ...        ...      ...       ...
        spectrum           3            HST ...    science 23902270 139244759
        spectrum           3            HST ...    science 23902267 139244763
        spectrum           3            HST ...    science 23902333 139244764
        spectrum           3            HST ...    science 23902247 139244767
        spectrum           3            HST ...    science 23902642 139245484
        spectrum           3            HST ...    science 23902688 139245487
           image           3            HST ...    science 24807268 139251148
Length = 1115 rows

Use a mask so that we only download data taken during the wanted times

[8]:

# create mask
select = (t_min_obs <= proposal_obs['t_min'].value.data) & (proposal_obs['t_min'].value.data <= t_max_obs)

[9]:

# mask main array
proposal_obs_select = proposal_obs[select]

[10]:

# list data products available during these times
data_products = Observations.get_product_list(proposal_obs_select)
print("Number of results:",len(data_products))
print(data_products)

Number of results: 2090
 obsID   obs_collection dataproduct_type ... dataRights calib_level
-------- -------------- ---------------- ... ---------- -----------
26572598            HST            image ...     PUBLIC           3
26572598            HST            image ...     PUBLIC           3
26572598            HST            image ...     PUBLIC           3
26572598            HST            image ...     PUBLIC           3
26572598            HST            image ...     PUBLIC           3
26572592            HST            image ...     PUBLIC           2
26572592            HST            image ...     PUBLIC           2
     ...            ...              ... ...        ...         ...
23902071            HST         spectrum ...     PUBLIC           1
23902071            HST         spectrum ...     PUBLIC           1
23902071            HST         spectrum ...     PUBLIC           3
23902071            HST         spectrum ...     PUBLIC           2
23902071            HST         spectrum ...     PUBLIC           1
23902071            HST         spectrum ...     PUBLIC           3
23902071            HST         spectrum ...     PUBLIC           2
Length = 2090 rows

We just want the _ima files

PACMAN can currently just work with files with an ima extension, so you want to select these. ima is an intermediate data product standing for calibrated intermediate IR multiaccum image. From theWFC3 data handbook: “For the IR detector, an intermediate MultiAccum (ima) file is the result after all calibrations are applied (dark subtraction, linearity correction, flat fielding, etc.) to all of the individual readouts of the IR exposure.”

[11]:

# only select IMA files
data_products_ima = data_products[data_products['productSubGroupDescription'] == 'IMA']
print(data_products_ima)

 obsID   obs_collection dataproduct_type ... dataRights calib_level
-------- -------------- ---------------- ... ---------- -----------
23901914            HST            image ...     PUBLIC           2
23901915            HST         spectrum ...     PUBLIC           2
23901916            HST         spectrum ...     PUBLIC           2
23901917            HST         spectrum ...     PUBLIC           2
23901918            HST         spectrum ...     PUBLIC           2
23901919            HST         spectrum ...     PUBLIC           2
23901920            HST         spectrum ...     PUBLIC           2
     ...            ...              ... ...        ...         ...
23902065            HST         spectrum ...     PUBLIC           2
23902066            HST         spectrum ...     PUBLIC           2
23902067            HST         spectrum ...     PUBLIC           2
23902068            HST         spectrum ...     PUBLIC           2
23902069            HST         spectrum ...     PUBLIC           2
23902070            HST         spectrum ...     PUBLIC           2
23902071            HST         spectrum ...     PUBLIC           2
Length = 158 rows

Download the data

[12]:

Observations.download_products(data_products_ima,mrp_only=False)

Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06d0q_ima.fits to ./mastDownload/HST/ibxy06d0q/ibxy06d0q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06d1q_ima.fits to ./mastDownload/HST/ibxy06d1q/ibxy06d1q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06d2q_ima.fits to ./mastDownload/HST/ibxy06d2q/ibxy06d2q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06d3q_ima.fits to ./mastDownload/HST/ibxy06d3q/ibxy06d3q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06d4q_ima.fits to ./mastDownload/HST/ibxy06d4q/ibxy06d4q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06d6q_ima.fits to ./mastDownload/HST/ibxy06d6q/ibxy06d6q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06d7q_ima.fits to ./mastDownload/HST/ibxy06d7q/ibxy06d7q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06d8q_ima.fits to ./mastDownload/HST/ibxy06d8q/ibxy06d8q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06daq_ima.fits to ./mastDownload/HST/ibxy06daq/ibxy06daq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06dbq_ima.fits to ./mastDownload/HST/ibxy06dbq/ibxy06dbq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06dcq_ima.fits to ./mastDownload/HST/ibxy06dcq/ibxy06dcq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06deq_ima.fits to ./mastDownload/HST/ibxy06deq/ibxy06deq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06dfq_ima.fits to ./mastDownload/HST/ibxy06dfq/ibxy06dfq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06dgq_ima.fits to ./mastDownload/HST/ibxy06dgq/ibxy06dgq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06diq_ima.fits to ./mastDownload/HST/ibxy06diq/ibxy06diq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06djq_ima.fits to ./mastDownload/HST/ibxy06djq/ibxy06djq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06dnq_ima.fits to ./mastDownload/HST/ibxy06dnq/ibxy06dnq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06dpq_ima.fits to ./mastDownload/HST/ibxy06dpq/ibxy06dpq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06dqq_ima.fits to ./mastDownload/HST/ibxy06dqq/ibxy06dqq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06dvq_ima.fits to ./mastDownload/HST/ibxy06dvq/ibxy06dvq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06dwq_ima.fits to ./mastDownload/HST/ibxy06dwq/ibxy06dwq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06dyq_ima.fits to ./mastDownload/HST/ibxy06dyq/ibxy06dyq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06dzq_ima.fits to ./mastDownload/HST/ibxy06dzq/ibxy06dzq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06e0q_ima.fits to ./mastDownload/HST/ibxy06e0q/ibxy06e0q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06e2q_ima.fits to ./mastDownload/HST/ibxy06e2q/ibxy06e2q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06e3q_ima.fits to ./mastDownload/HST/ibxy06e3q/ibxy06e3q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06e4q_ima.fits to ./mastDownload/HST/ibxy06e4q/ibxy06e4q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06e6q_ima.fits to ./mastDownload/HST/ibxy06e6q/ibxy06e6q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06e7q_ima.fits to ./mastDownload/HST/ibxy06e7q/ibxy06e7q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06e8q_ima.fits to ./mastDownload/HST/ibxy06e8q/ibxy06e8q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06eaq_ima.fits to ./mastDownload/HST/ibxy06eaq/ibxy06eaq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06ebq_ima.fits to ./mastDownload/HST/ibxy06ebq/ibxy06ebq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06ecq_ima.fits to ./mastDownload/HST/ibxy06ecq/ibxy06ecq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06eeq_ima.fits to ./mastDownload/HST/ibxy06eeq/ibxy06eeq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06efq_ima.fits to ./mastDownload/HST/ibxy06efq/ibxy06efq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06egq_ima.fits to ./mastDownload/HST/ibxy06egq/ibxy06egq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06eiq_ima.fits to ./mastDownload/HST/ibxy06eiq/ibxy06eiq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06ejq_ima.fits to ./mastDownload/HST/ibxy06ejq/ibxy06ejq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06ekq_ima.fits to ./mastDownload/HST/ibxy06ekq/ibxy06ekq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06enq_ima.fits to ./mastDownload/HST/ibxy06enq/ibxy06enq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06eoq_ima.fits to ./mastDownload/HST/ibxy06eoq/ibxy06eoq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06epq_ima.fits to ./mastDownload/HST/ibxy06epq/ibxy06epq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06eqq_ima.fits to ./mastDownload/HST/ibxy06eqq/ibxy06eqq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06esq_ima.fits to ./mastDownload/HST/ibxy06esq/ibxy06esq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06etq_ima.fits to ./mastDownload/HST/ibxy06etq/ibxy06etq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06euq_ima.fits to ./mastDownload/HST/ibxy06euq/ibxy06euq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06ewq_ima.fits to ./mastDownload/HST/ibxy06ewq/ibxy06ewq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06exq_ima.fits to ./mastDownload/HST/ibxy06exq/ibxy06exq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06eyq_ima.fits to ./mastDownload/HST/ibxy06eyq/ibxy06eyq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06f0q_ima.fits to ./mastDownload/HST/ibxy06f0q/ibxy06f0q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06f1q_ima.fits to ./mastDownload/HST/ibxy06f1q/ibxy06f1q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06f2q_ima.fits to ./mastDownload/HST/ibxy06f2q/ibxy06f2q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06f4q_ima.fits to ./mastDownload/HST/ibxy06f4q/ibxy06f4q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06f5q_ima.fits to ./mastDownload/HST/ibxy06f5q/ibxy06f5q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06f6q_ima.fits to ./mastDownload/HST/ibxy06f6q/ibxy06f6q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06f8q_ima.fits to ./mastDownload/HST/ibxy06f8q/ibxy06f8q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06f9q_ima.fits to ./mastDownload/HST/ibxy06f9q/ibxy06f9q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06faq_ima.fits to ./mastDownload/HST/ibxy06faq/ibxy06faq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06fcq_ima.fits to ./mastDownload/HST/ibxy06fcq/ibxy06fcq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06fdq_ima.fits to ./mastDownload/HST/ibxy06fdq/ibxy06fdq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06feq_ima.fits to ./mastDownload/HST/ibxy06feq/ibxy06feq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06ffq_ima.fits to ./mastDownload/HST/ibxy06ffq/ibxy06ffq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06fhq_ima.fits to ./mastDownload/HST/ibxy06fhq/ibxy06fhq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06fiq_ima.fits to ./mastDownload/HST/ibxy06fiq/ibxy06fiq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06fjq_ima.fits to ./mastDownload/HST/ibxy06fjq/ibxy06fjq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06fkq_ima.fits to ./mastDownload/HST/ibxy06fkq/ibxy06fkq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06flq_ima.fits to ./mastDownload/HST/ibxy06flq/ibxy06flq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06fmq_ima.fits to ./mastDownload/HST/ibxy06fmq/ibxy06fmq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06fnq_ima.fits to ./mastDownload/HST/ibxy06fnq/ibxy06fnq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06foq_ima.fits to ./mastDownload/HST/ibxy06foq/ibxy06foq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06fpq_ima.fits to ./mastDownload/HST/ibxy06fpq/ibxy06fpq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06fqq_ima.fits to ./mastDownload/HST/ibxy06fqq/ibxy06fqq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06frq_ima.fits to ./mastDownload/HST/ibxy06frq/ibxy06frq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06fsq_ima.fits to ./mastDownload/HST/ibxy06fsq/ibxy06fsq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06ftq_ima.fits to ./mastDownload/HST/ibxy06ftq/ibxy06ftq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06fuq_ima.fits to ./mastDownload/HST/ibxy06fuq/ibxy06fuq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06fvq_ima.fits to ./mastDownload/HST/ibxy06fvq/ibxy06fvq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06fwq_ima.fits to ./mastDownload/HST/ibxy06fwq/ibxy06fwq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy06fxq_ima.fits to ./mastDownload/HST/ibxy06fxq/ibxy06fxq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07p9q_ima.fits to ./mastDownload/HST/ibxy07p9q/ibxy07p9q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07paq_ima.fits to ./mastDownload/HST/ibxy07paq/ibxy07paq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07pbq_ima.fits to ./mastDownload/HST/ibxy07pbq/ibxy07pbq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07pcq_ima.fits to ./mastDownload/HST/ibxy07pcq/ibxy07pcq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07pdq_ima.fits to ./mastDownload/HST/ibxy07pdq/ibxy07pdq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07pfq_ima.fits to ./mastDownload/HST/ibxy07pfq/ibxy07pfq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07pgq_ima.fits to ./mastDownload/HST/ibxy07pgq/ibxy07pgq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07phq_ima.fits to ./mastDownload/HST/ibxy07phq/ibxy07phq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07pjq_ima.fits to ./mastDownload/HST/ibxy07pjq/ibxy07pjq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07pkq_ima.fits to ./mastDownload/HST/ibxy07pkq/ibxy07pkq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07plq_ima.fits to ./mastDownload/HST/ibxy07plq/ibxy07plq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07pnq_ima.fits to ./mastDownload/HST/ibxy07pnq/ibxy07pnq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07poq_ima.fits to ./mastDownload/HST/ibxy07poq/ibxy07poq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07ppq_ima.fits to ./mastDownload/HST/ibxy07ppq/ibxy07ppq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07prq_ima.fits to ./mastDownload/HST/ibxy07prq/ibxy07prq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07psq_ima.fits to ./mastDownload/HST/ibxy07psq/ibxy07psq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07ptq_ima.fits to ./mastDownload/HST/ibxy07ptq/ibxy07ptq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07pvq_ima.fits to ./mastDownload/HST/ibxy07pvq/ibxy07pvq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07pwq_ima.fits to ./mastDownload/HST/ibxy07pwq/ibxy07pwq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07pxq_ima.fits to ./mastDownload/HST/ibxy07pxq/ibxy07pxq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07pyq_ima.fits to ./mastDownload/HST/ibxy07pyq/ibxy07pyq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07q0q_ima.fits to ./mastDownload/HST/ibxy07q0q/ibxy07q0q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07q1q_ima.fits to ./mastDownload/HST/ibxy07q1q/ibxy07q1q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07q2q_ima.fits to ./mastDownload/HST/ibxy07q2q/ibxy07q2q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07q4q_ima.fits to ./mastDownload/HST/ibxy07q4q/ibxy07q4q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07q5q_ima.fits to ./mastDownload/HST/ibxy07q5q/ibxy07q5q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07q6q_ima.fits to ./mastDownload/HST/ibxy07q6q/ibxy07q6q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07q8q_ima.fits to ./mastDownload/HST/ibxy07q8q/ibxy07q8q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07q9q_ima.fits to ./mastDownload/HST/ibxy07q9q/ibxy07q9q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07qaq_ima.fits to ./mastDownload/HST/ibxy07qaq/ibxy07qaq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07qcq_ima.fits to ./mastDownload/HST/ibxy07qcq/ibxy07qcq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07qdq_ima.fits to ./mastDownload/HST/ibxy07qdq/ibxy07qdq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07qeq_ima.fits to ./mastDownload/HST/ibxy07qeq/ibxy07qeq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07qgq_ima.fits to ./mastDownload/HST/ibxy07qgq/ibxy07qgq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07qhq_ima.fits to ./mastDownload/HST/ibxy07qhq/ibxy07qhq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07qiq_ima.fits to ./mastDownload/HST/ibxy07qiq/ibxy07qiq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07qkq_ima.fits to ./mastDownload/HST/ibxy07qkq/ibxy07qkq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07qlq_ima.fits to ./mastDownload/HST/ibxy07qlq/ibxy07qlq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07qmq_ima.fits to ./mastDownload/HST/ibxy07qmq/ibxy07qmq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07qoq_ima.fits to ./mastDownload/HST/ibxy07qoq/ibxy07qoq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07qpq_ima.fits to ./mastDownload/HST/ibxy07qpq/ibxy07qpq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07qqq_ima.fits to ./mastDownload/HST/ibxy07qqq/ibxy07qqq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07qrq_ima.fits to ./mastDownload/HST/ibxy07qrq/ibxy07qrq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07qtq_ima.fits to ./mastDownload/HST/ibxy07qtq/ibxy07qtq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07quq_ima.fits to ./mastDownload/HST/ibxy07quq/ibxy07quq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07qvq_ima.fits to ./mastDownload/HST/ibxy07qvq/ibxy07qvq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07qxq_ima.fits to ./mastDownload/HST/ibxy07qxq/ibxy07qxq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07qyq_ima.fits to ./mastDownload/HST/ibxy07qyq/ibxy07qyq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07qzq_ima.fits to ./mastDownload/HST/ibxy07qzq/ibxy07qzq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07r1q_ima.fits to ./mastDownload/HST/ibxy07r1q/ibxy07r1q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07r2q_ima.fits to ./mastDownload/HST/ibxy07r2q/ibxy07r2q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07r3q_ima.fits to ./mastDownload/HST/ibxy07r3q/ibxy07r3q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07r5q_ima.fits to ./mastDownload/HST/ibxy07r5q/ibxy07r5q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07r6q_ima.fits to ./mastDownload/HST/ibxy07r6q/ibxy07r6q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07r7q_ima.fits to ./mastDownload/HST/ibxy07r7q/ibxy07r7q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07r9q_ima.fits to ./mastDownload/HST/ibxy07r9q/ibxy07r9q_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07raq_ima.fits to ./mastDownload/HST/ibxy07raq/ibxy07raq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07rbq_ima.fits to ./mastDownload/HST/ibxy07rbq/ibxy07rbq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07rdq_ima.fits to ./mastDownload/HST/ibxy07rdq/ibxy07rdq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07req_ima.fits to ./mastDownload/HST/ibxy07req/ibxy07req_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07rfq_ima.fits to ./mastDownload/HST/ibxy07rfq/ibxy07rfq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07rgq_ima.fits to ./mastDownload/HST/ibxy07rgq/ibxy07rgq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07riq_ima.fits to ./mastDownload/HST/ibxy07riq/ibxy07riq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07rjq_ima.fits to ./mastDownload/HST/ibxy07rjq/ibxy07rjq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07rkq_ima.fits to ./mastDownload/HST/ibxy07rkq/ibxy07rkq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07rlq_ima.fits to ./mastDownload/HST/ibxy07rlq/ibxy07rlq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07rmq_ima.fits to ./mastDownload/HST/ibxy07rmq/ibxy07rmq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07rnq_ima.fits to ./mastDownload/HST/ibxy07rnq/ibxy07rnq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07roq_ima.fits to ./mastDownload/HST/ibxy07roq/ibxy07roq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07rpq_ima.fits to ./mastDownload/HST/ibxy07rpq/ibxy07rpq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07rqq_ima.fits to ./mastDownload/HST/ibxy07rqq/ibxy07rqq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07rrq_ima.fits to ./mastDownload/HST/ibxy07rrq/ibxy07rrq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07rsq_ima.fits to ./mastDownload/HST/ibxy07rsq/ibxy07rsq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07rtq_ima.fits to ./mastDownload/HST/ibxy07rtq/ibxy07rtq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07ruq_ima.fits to ./mastDownload/HST/ibxy07ruq/ibxy07ruq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07rvq_ima.fits to ./mastDownload/HST/ibxy07rvq/ibxy07rvq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07rwq_ima.fits to ./mastDownload/HST/ibxy07rwq/ibxy07rwq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07rxq_ima.fits to ./mastDownload/HST/ibxy07rxq/ibxy07rxq_ima.fits ... [Done]
Downloading URL https://mast.stsci.edu/api/v0.1/Download/file?uri=mast:HST/product/ibxy07ryq_ima.fits to ./mastDownload/HST/ibxy07ryq/ibxy07ryq_ima.fits ... [Done]

[12]:

Table length=158

Local Path	Status	Message	URL
str47	str8	object	object
./mastDownload/HST/ibxy06d0q/ibxy06d0q_ima.fits	COMPLETE	None	None
./mastDownload/HST/ibxy06d1q/ibxy06d1q_ima.fits	COMPLETE	None	None
./mastDownload/HST/ibxy06d2q/ibxy06d2q_ima.fits	COMPLETE	None	None
./mastDownload/HST/ibxy06d3q/ibxy06d3q_ima.fits	COMPLETE	None	None
./mastDownload/HST/ibxy06d4q/ibxy06d4q_ima.fits	COMPLETE	None	None
./mastDownload/HST/ibxy06d6q/ibxy06d6q_ima.fits	COMPLETE	None	None
...	...	...	...
./mastDownload/HST/ibxy07rsq/ibxy07rsq_ima.fits	COMPLETE	None	None
./mastDownload/HST/ibxy07rtq/ibxy07rtq_ima.fits	COMPLETE	None	None
./mastDownload/HST/ibxy07ruq/ibxy07ruq_ima.fits	COMPLETE	None	None
./mastDownload/HST/ibxy07rvq/ibxy07rvq_ima.fits	COMPLETE	None	None
./mastDownload/HST/ibxy07rwq/ibxy07rwq_ima.fits	COMPLETE	None	None
./mastDownload/HST/ibxy07rxq/ibxy07rxq_ima.fits	COMPLETE	None	None
./mastDownload/HST/ibxy07ryq/ibxy07ryq_ima.fits	COMPLETE	None	None

The files were all saved in separate directories with the following format:

mastDownload
- HST
  - file1
    - file1_ima.fits
  - file2
    - file2_ima.fits
  - file3
    - file3_ima.fits

etc…

Let’s now move all these IMA files into a common directory.

[13]:

file_path = os.path.dirname(os.path.abspath("__file__"))

[14]:

file_path

[14]:

'/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source'

[15]:

root_dir = file_path + '/mastDownload/HST' # Specify root directory to be searched for .sav files.
move_dir = file_path
filelist = []

# list all ima files in the subdirectories
for tree,fol,fils in os.walk(root_dir):
    filelist.extend([os.path.join(tree,fil) for fil in fils if fil.endswith('.fits')])

[16]:

# all dowloaded ima files
print(filelist)

['/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07rkq/ibxy07rkq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06ecq/ibxy06ecq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06fcq/ibxy06fcq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07qiq/ibxy07qiq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06f5q/ibxy06f5q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07qaq/ibxy07qaq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07rdq/ibxy07rdq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06esq/ibxy06esq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06eoq/ibxy06eoq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07r5q/ibxy07r5q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06e8q/ibxy06e8q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07qxq/ibxy07qxq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07qkq/ibxy07qkq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06d7q/ibxy06d7q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06enq/ibxy06enq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07r1q/ibxy07r1q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06e4q/ibxy06e4q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07rmq/ibxy07rmq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06e3q/ibxy06e3q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06fxq/ibxy06fxq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07rxq/ibxy07rxq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07pkq/ibxy07pkq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06dfq/ibxy06dfq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07rfq/ibxy07rfq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07pvq/ibxy07pvq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06faq/ibxy06faq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07rsq/ibxy07rsq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07rgq/ibxy07rgq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06dgq/ibxy06dgq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06dyq/ibxy06dyq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07psq/ibxy07psq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07riq/ibxy07riq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07r2q/ibxy07r2q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06fwq/ibxy06fwq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06d1q/ibxy06d1q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06d3q/ibxy06d3q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07pwq/ibxy07pwq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06fpq/ibxy06fpq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07pfq/ibxy07pfq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07q9q/ibxy07q9q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07pyq/ibxy07pyq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06eyq/ibxy06eyq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06flq/ibxy06flq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06f0q/ibxy06f0q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06d0q/ibxy06d0q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07qrq/ibxy07qrq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06ewq/ibxy06ewq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06fuq/ibxy06fuq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06fjq/ibxy06fjq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06efq/ibxy06efq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06exq/ibxy06exq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06egq/ibxy06egq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06fqq/ibxy06fqq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07ryq/ibxy07ryq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06fmq/ibxy06fmq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06ffq/ibxy06ffq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07qqq/ibxy07qqq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07phq/ibxy07phq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06foq/ibxy06foq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07req/ibxy07req_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07p9q/ibxy07p9q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06d6q/ibxy06d6q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07r6q/ibxy07r6q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06f4q/ibxy06f4q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06fsq/ibxy06fsq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06frq/ibxy06frq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07q2q/ibxy07q2q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06f6q/ibxy06f6q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07rqq/ibxy07rqq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07pgq/ibxy07pgq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07qeq/ibxy07qeq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07q4q/ibxy07q4q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07rtq/ibxy07rtq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06fdq/ibxy06fdq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07qdq/ibxy07qdq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07pcq/ibxy07pcq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06dbq/ibxy06dbq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07q6q/ibxy07q6q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07ruq/ibxy07ruq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07qoq/ibxy07qoq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06dzq/ibxy06dzq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07qzq/ibxy07qzq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06eaq/ibxy06eaq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06etq/ibxy06etq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07q8q/ibxy07q8q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07rlq/ibxy07rlq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06d4q/ibxy06d4q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06fkq/ibxy06fkq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06fhq/ibxy06fhq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07prq/ibxy07prq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07q0q/ibxy07q0q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07pxq/ibxy07pxq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06eiq/ibxy06eiq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07pjq/ibxy07pjq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07poq/ibxy07poq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07quq/ibxy07quq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07qcq/ibxy07qcq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06ejq/ibxy06ejq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06diq/ibxy06diq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06daq/ibxy06daq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07q1q/ibxy07q1q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06dnq/ibxy06dnq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06dcq/ibxy06dcq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07r9q/ibxy07r9q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07qmq/ibxy07qmq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07rjq/ibxy07rjq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06ftq/ibxy06ftq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06dqq/ibxy06dqq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07raq/ibxy07raq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06feq/ibxy06feq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07q5q/ibxy07q5q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06fiq/ibxy06fiq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06f8q/ibxy06f8q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06fnq/ibxy06fnq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07rnq/ibxy07rnq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07r3q/ibxy07r3q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06djq/ibxy06djq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07roq/ibxy07roq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07rpq/ibxy07rpq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06eeq/ibxy06eeq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07ppq/ibxy07ppq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07pdq/ibxy07pdq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07rbq/ibxy07rbq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07pnq/ibxy07pnq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06f9q/ibxy06f9q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07r7q/ibxy07r7q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07qvq/ibxy07qvq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06e0q/ibxy06e0q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06f2q/ibxy06f2q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06d2q/ibxy06d2q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07qlq/ibxy07qlq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06ebq/ibxy06ebq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07qtq/ibxy07qtq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06f1q/ibxy06f1q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07qgq/ibxy07qgq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07pbq/ibxy07pbq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07qpq/ibxy07qpq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06epq/ibxy06epq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07qyq/ibxy07qyq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06e7q/ibxy06e7q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06deq/ibxy06deq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07rvq/ibxy07rvq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07rrq/ibxy07rrq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07qhq/ibxy07qhq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06euq/ibxy06euq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06eqq/ibxy06eqq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06fvq/ibxy06fvq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06dvq/ibxy06dvq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07ptq/ibxy07ptq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07rwq/ibxy07rwq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06dwq/ibxy06dwq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07paq/ibxy07paq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06ekq/ibxy06ekq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy07plq/ibxy07plq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06d8q/ibxy06d8q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06e2q/ibxy06e2q_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06dpq/ibxy06dpq_ima.fits', '/home/zieba/Desktop/Projects/Open_source/PACMAN/docs/source/mastDownload/HST/ibxy06e6q/ibxy06e6q_ima.fits']

[17]:

for fil in filelist:
    name = fil.split('/')[-1]
    os.rename(fil,move_dir + '/' + name)

[18]:

# delete the mastDownload directory
os.system("rm -r {0}".format(file_path + '/mastDownload'))

[18]:

Now all 158 IMA files are in the same directory as the script and we can use this directory as the data directory. You can obviously alternatively move this files somewhere else. This directory which includes all the fits files will be your “data directory”.

Follow along to Stage 00, to start with Stage 00 of PACMAN.