tools/centos-mirror-tools
Marcela Rosales 1a539ac2a5 Change lists names and downloading scripts
-By standardizing the list files name it's possible to eliminate
one parameter in the download function in dl_rpms and reduce complexity.
-Now the download function does not receive it as a parameter anymore,
and instead it gets it from the RPM name.
-Also the download function now decides if build a wget command or
a yumdownloader commnad based on the content of the list (by identifying
the # character) instead of using the name of the list.

I adapted download_mirror.sh.

Change-Id: I041fc9c704156215f06149e5b4c16cd92990e17c
Signed-off-by: Marcela Rosales <marcela.a.rosales.jimenez@intel.com>
2018-08-15 16:56:43 -05:00
..
rpm-gpg-keys Adding StarlingX_3rd.repo sourcelist for 3rd pkgs 2018-06-27 21:07:36 -05:00
yum.repos.d Switch kubernetes-1.10.0-1.el7.src.rpm from 3rd-party download to centos_repo 2018-08-11 01:30:58 +08:00
Dockerfile Split and move repo data files to yum.repo.d subdirectory. 2018-08-07 16:48:16 -04:00
README.rst Port documentation from markdown into rst file 2 2018-07-09 09:43:00 -05:00
dl_other_from_centos_repo.sh Add build tools 2018-06-08 17:01:43 -05:00
dl_rpms.sh Change lists names and downloading scripts 2018-08-15 16:56:43 -05:00
dl_tarball.sh Improved local mirror support in tools 2018-08-13 15:53:43 -04:00
download_mirror.sh Change lists names and downloading scripts 2018-08-15 16:56:43 -05:00
mvn-artifacts.lst StarlingX: Tar Compressed files repository 2018-07-03 06:04:28 -07:00
other_downloads.lst Add build tools 2018-06-08 17:01:43 -05:00
rpms_3rdparties.lst Change lists names and downloading scripts 2018-08-15 16:56:43 -05:00
rpms_centos.lst Change lists names and downloading scripts 2018-08-15 16:56:43 -05:00
rpms_centos3rdparties.lst Change lists names and downloading scripts 2018-08-15 16:56:43 -05:00
show_imported_rpm_gpg_keys.sh Add build tools 2018-06-08 17:01:43 -05:00
starlingx_add_pkgs.sh Merge "Split and move repo data files to yum.repo.d subdirectory." 2018-08-08 16:25:51 +00:00
tarball-dl.lst Add packages required for the introduction of gnocchi 2018-07-31 00:11:25 -05:00

README.rst

Create mirror for StarlingX

Step 0 - Build the container

Build the docker image on your Linux host (with Docker supported). NOTE: if necessary you might have to set http/https proxy in your Dockerfile before building the docker image below.

$ docker build -t <your_docker_image_name>:<your_image_version> -f Dockerfile .

Step 1 - Run the container

The container shall be run from the same directory where the other scripts are stored.

$ docker run -it -v $(pwd):/localdisk <your_docker_image_name>:<your_image_version>

The container can also be run the following way, so the download_mirror.sh runs automatically without having to enter the container and the step 2can be simplified.

$ docker run -it -v $(pwd):/localdisk <your_docker_image_name>:<your_image_version> download_mirror.sh

As /localdisk is defined as the workdir of the container, the same folder name should be used to define the volume. The container will start to run and populate a logs and output folders in this directory. The container shall be run from the same directory where the other scripts are stored.

step 2 - Run the download_mirror.sh script

Once inside the container run the downloader script

$ ./download_mirror.sh

NOTE: in case there are some downloading failures due to network instability (or timeout), you should download them manually, to assure you get all RPMs listed in "rpms_from_3rd_parties.lst" and "rpms_from_centos_repo.lst".

step 3 - Copy the files to the mirror

After all downloading complete, copy the download files to mirror.

$ find ./output -name "*.i686.rpm" | xargs rm -f $ chown 751:751 -R ./output $ cp -rf output/stx-r1/ <your_mirror_folder>/

In this case <your_mirror_folder> can be whatever folder you want to use as mirror.

step 4 - Tweaks in the StarlingX build system.

NOTE: step below is not needed if you've synced the latest codebase.

Go into StarlingX build system (another container which hosts cgcs build system), and follow up below steps:

Debugging issues

The download_mirror.sh script will create log files in the form of centos_rpms_*.txt. After the download is complete, it's recommended to check the content of these files to see if everything was downloaded correctly.

A quick look into these files could be:

$ cd output/ $ cat missing

In this case, there shoudn't be any package in the "missing" files.