tools/centos-mirror-tools
Marcela Rosales 2c023c7772 Add need_file function to download_mirror.sh
I added the need_file function and used it to verify the existence
of files needed by download_mirror.sh (lists and bash scripts).

Change-Id: Iea2ca7776ed1c30a2fec7e8e00bf7acb5ca46c90
Signed-off-by: Marcela Rosales <marcela.a.rosales.jimenez@intel.com>
2018-08-09 11:17:19 -05:00
..
rpm-gpg-keys Adding StarlingX_3rd.repo sourcelist for 3rd pkgs 2018-06-27 21:07:36 -05:00
yum.repos.d Split and move repo data files to yum.repo.d subdirectory. 2018-08-07 16:48:16 -04:00
Dockerfile Split and move repo data files to yum.repo.d subdirectory. 2018-08-07 16:48:16 -04:00
README.rst Port documentation from markdown into rst file 2 2018-07-09 09:43:00 -05:00
dl_other_from_centos_repo.sh Add build tools 2018-06-08 17:01:43 -05:00
dl_rpms.sh Log the urls of downloaded rpms 2018-07-30 16:15:10 -04:00
dl_tarball.sh Change name of tarball-dl.sh to dl_tarball.sh 2018-08-08 09:36:12 -05:00
download_mirror.sh Add need_file function to download_mirror.sh 2018-08-09 11:17:19 -05:00
mvn-artifacts.lst StarlingX: Tar Compressed files repository 2018-07-03 06:04:28 -07:00
other_downloads.lst Add build tools 2018-06-08 17:01:43 -05:00
rpms_from_3rd_parties.lst removing no require lines for download pkg 2018-07-05 16:15:34 -05:00
rpms_from_centos_3rd_parties.lst update rpm/srpm to CentOS7.5 version to avoid package missing in repo 2018-08-07 18:44:12 +08:00
rpms_from_centos_repo.lst Replace seabios with Centos built version 2018-08-03 17:14:25 -04:00
show_imported_rpm_gpg_keys.sh Add build tools 2018-06-08 17:01:43 -05:00
starlingx_add_pkgs.sh Merge "Split and move repo data files to yum.repo.d subdirectory." 2018-08-08 16:25:51 +00:00
tarball-dl.lst Add packages required for the introduction of gnocchi 2018-07-31 00:11:25 -05:00

README.rst

Create mirror for StarlingX

Step 0 - Build the container

Build the docker image on your Linux host (with Docker supported). NOTE: if necessary you might have to set http/https proxy in your Dockerfile before building the docker image below.

$ docker build -t <your_docker_image_name>:<your_image_version> -f Dockerfile .

Step 1 - Run the container

The container shall be run from the same directory where the other scripts are stored.

$ docker run -it -v $(pwd):/localdisk <your_docker_image_name>:<your_image_version>

The container can also be run the following way, so the download_mirror.sh runs automatically without having to enter the container and the step 2can be simplified.

$ docker run -it -v $(pwd):/localdisk <your_docker_image_name>:<your_image_version> download_mirror.sh

As /localdisk is defined as the workdir of the container, the same folder name should be used to define the volume. The container will start to run and populate a logs and output folders in this directory. The container shall be run from the same directory where the other scripts are stored.

step 2 - Run the download_mirror.sh script

Once inside the container run the downloader script

$ ./download_mirror.sh

NOTE: in case there are some downloading failures due to network instability (or timeout), you should download them manually, to assure you get all RPMs listed in "rpms_from_3rd_parties.lst" and "rpms_from_centos_repo.lst".

step 3 - Copy the files to the mirror

After all downloading complete, copy the download files to mirror.

$ find ./output -name "*.i686.rpm" | xargs rm -f $ chown 751:751 -R ./output $ cp -rf output/stx-r1/ <your_mirror_folder>/

In this case <your_mirror_folder> can be whatever folder you want to use as mirror.

step 4 - Tweaks in the StarlingX build system.

NOTE: step below is not needed if you've synced the latest codebase.

Go into StarlingX build system (another container which hosts cgcs build system), and follow up below steps:

Debugging issues

The download_mirror.sh script will create log files in the form of centos_rpms_*.txt. After the download is complete, it's recommended to check the content of these files to see if everything was downloaded correctly.

A quick look into these files could be:

$ cd output/ $ cat missing

In this case, there shoudn't be any package in the "missing" files.