[Release Automation] Extend release pipeline creating zip files for source code as required by Apache

[eduardocerqueira]

extend pipelines adding step to compress in a tarball/zip the source code as it is required for releasing in Apache.

PS: it is for all repos targeting the 10.0.0 release.

[cimbalek]

@eduardocerqueira Do we want to produce zips per repository or is one huge zip preferred?

[porcelli]

this is what I wrote for Jenkins, this should do the job:

def repos = [
    [name: 'kie-drools', url: 'https://github.com/apache/incubator-kie-drools.git'],
    [name: 'kie-optaplanner', url: 'https://github.com/apache/incubator-kie-optaplanner.git'],
    [name: 'kie-kogito-runtimes', url: 'https://github.com/apache/incubator-kie-kogito-runtimes.git'],
    [name: 'kie-kogito-apps', url: 'https://github.com/apache/incubator-kie-kogito-apps.git'],
    [name: 'kie-kogito-images', url: 'https://github.com/apache/incubator-kie-kogito-images.git'],
    [name: 'kie-tools', url: 'https://github.com/apache/incubator-kie-tools.git'],
    [name: 'kie-sandbox-quarkus-accelerator', url: 'https://github.com/apache/incubator-kie-sandbox-quarkus-accelerator.git']
]

pipeline {
    agent any

    parameters {
        string(name: 'BRANCH_NAME', defaultValue: 'main', description: 'Branch name to use for all repositories')
        string(name: 'VERSION_NUMBER', defaultValue: '1.0.0', description: 'Version number for the ZIP file')
    }

    environment {
        ZIP_FILE_NAME = "apache-kie-${params.VERSION_NUMBER}.zip"
    }

    stages {
        stage('Clone Repositories') {
            steps {
                script {
                    repos.each { repo ->
                        dir(repo.name) {
                            git branch: params.BRANCH_NAME, url: repo.url
                        }
                    }
                }
            }
        }

        stage('Remove .git Directories') {
            steps {
                script {
                    repos.each { repo ->
                        sh "rm -rf ${repo.name}/.git"
                    }
                }
            }
        }

        stage('Create ZIP File') {
            steps {
                script {
                    def repoNames = repos.collect { it.name }
                    sh "zip -r ${env.ZIP_FILE_NAME} ${repoNames.join(' ')}"
                }
            }
        }

        stage('Archive ZIP') {
            steps {
                archiveArtifacts artifacts: env.ZIP_FILE_NAME, allowEmptyArchive: false
            }
        }
    }

    post {
        always {
            cleanWs()
        }
    }
}

[porcelli]

this is supposed to be a permanent automation to release in Apache

[cimbalek]

PR with Implementation is here: apache/incubator-kie-kogito-pipelines#1202 - please review
I decided to go with BASH script as it is better transferrable than a jenkins job and in case of need can be run locally. Also, I had it done when Alex posted the job code. I was just testing.

Job that builds it can be found here: https://ci-builds.apache.org/job/KIE/job/tools/job/zip-sources/
For now I agreed with Jan that separate job will be fine and we can include the script in pipelines later.

[baldimir]

@cimbalek I think what Alex did creates one big zip. In the zip script, it creates one zip per repository. Could you please update the script, that it just clones everything and does on big zip of the whole folder with all repositories?

[cimbalek]

apache/incubator-kie-kogito-pipelines#1202