Replace tarball generation in release.py by a Jenkins job

[j-rivero]

Members of the Gazebo core team currently need to push files to S3 during the release process for Gazebo packages (including sdformat) using personal S3 credentials. The upload is handled using the release.py script. Moving this process into a centralized automation system will support growing the Gazebo core team without requiring the granting of S3 bucket access to more individuals and remove the need for existing personal credentials.

Implementation:
Spawn a generation job in Jenkins from release.py, which will create the source tarball and push it to S3 and/or GitHub Releases, it could potentially also create the Debian source package and trigger the release upload for the source package only. Then on success, trigger the numerous parameterized debbuilder jobs. The release.py job could either block until the “source release” job is complete or just exit once it is triggered and rely on Jenkins to notify the releaser that their triggered “source builder” or one of the subsequently triggered debbuilder jobs failed.

Roadmap:

• Implement the tarball generation Jenkins job Source code generation Jenkins DSL support #989
• Implement a Jenkins job to call release.py Add OSRFReleasepy DSL class #988
• Draft the job chain in Jenkins that involves tarball creation + repository_uploader + release.py 91c57f1
• Implement the job chain in DSL
  • Add OSRFReleasepy DSL class #988
  • Source code generation Jenkins DSL support #989
  • Improve OSRFSourceCreation #1008
  • Fixes for OSRFSourceCreation and tests related #1024
  • OSRFSourceCreation needs to install gz-cmake to generate sources #1033
  • Add _releasepy job to be a wrapper of releasepy calls in Jenkins #1035
  • Generate source jobs using an index of source packages #1036
  • OSRFSourceCreation: use git refs directly instead of rebuild it #1046
• Prepare release.py to remove tarball generation
  • Big clean up of release.py script #1014
  • II part of clean up and refactoring release.py #1025
  • Change release.py to use the new centralized tarball approach #1048
• Prepare packages uploader to support tarball names
  • Make repository_uploader to support S3_FILES_TO_UPLOAD  #1006
• Update documentation
  • Update documentation for the new centralized tarball generation gazebosim/docs#403

[scpeters]

#1020 is kind of related

[j-rivero]

All merged.