Project

Profile

Help

Task #7279

Create yaml from http://maxscale-jenkins.mariadb.com:8090/job/mdbci_integration_test/

Added by Mark Zaslavskiy over 5 years ago. Updated almost 5 years ago.

Status:
Closed
Priority:
Normal
Category:
mdbci testing
Sprint/Milestone:
Start date:
20.07.2016
Due date:
% Done:

90%

Estimated time:
4:00 h
Target branch:
Test scenario:

https://github.com/OSLL/mdbci/tree/7279_create_yaml_from_mdbci_integration_test
https://github.com/OSLL/mdbci/pull/296

# Run some branch at:
http://maxscale-jenkins.mariadb.com:8090/view/All/job/7279_mdbci_integration_test//build?delay=0sec

# For testing, run some old success\fails branches and compare results.

# For compare xml's:
scp -i vagrant.pem vagranttest@maxscale-jenkins.mariadb.com:~/.jenkins/jobs/mdbci_integration_test/config.xml ~/some_dir

scp -i vagrant.pem vagranttest@maxscale-jenkins.mariadb.com:~/.jenkins/jobs/7279_mdbci_integration_test/config.xml ~/some_dir


Description

Investigate, how to create following sections in yaml and how they are filled in job mdbci_integration_test/
- Parameters
- SCM
- builders
- publishing
(Use docs and yamls from https://github.com/mariadb-corporation/maxscale-jenkins-jobs as examples (especialy run_test).)

Discuss decomposition of this task for implementing each section with Mark.


Related issues

Related to [mdbci] Maria DB Continuous integration tool - Task #7303: Create parametrs section in yaml http://maxscale-jenkins.mariadb.com:8090/job/mdbci_integration_test/Closed25.07.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to [mdbci] Maria DB Continuous integration tool - Task #7217: Remove product maxscale from mdbci_integration_test on maxscale-jenkinsWon't fix11.07.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to [mdbci] Maria DB Continuous integration tool - Task #7475: Add cleanup procedure from run_test to mdbci_integration_testClosed03.09.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>

History

#2 Updated by Ilfat Kinyaev over 5 years ago

  • Estimated time set to 4:00 h

#3 Updated by Ilfat Kinyaev over 5 years ago

  • Related to Task #7303: Create parametrs section in yaml http://maxscale-jenkins.mariadb.com:8090/job/mdbci_integration_test/ added

#4 Updated by Ilfat Kinyaev about 5 years ago

  • Status changed from New to Active / In progress

#5 Updated by Ilfat Kinyaev about 5 years ago

  • % Done changed from 0 to 60
  • Test scenario updated (diff)

1) Can't find var:
SVN Username
SVN Password

2) I will not break the server if upload this job? Can I make backup?

#6 Updated by Ilfat Kinyaev about 5 years ago

  • Related to Task #7217: Remove product maxscale from mdbci_integration_test on maxscale-jenkins added

#7 Updated by Ilfat Kinyaev about 5 years ago

  • Related to Task #7475: Add cleanup procedure from run_test to mdbci_integration_test added

#8 Updated by Mark Zaslavskiy about 5 years ago

For safety you can temporary rename job in yaml file.
In this case it will not replace existing one.

#9 Updated by Ilfat Kinyaev about 5 years ago

Comparing exit xml and new xml:
- Properties
-- EnvInjectJobProperty +
-- box +
-- product +
-- version ( in old: default )
-- do_not_destroy_vm +
-- com.moded.extendedchoiceparameter.ExtendedChoiceParameterDefinition in old and com.cwctravel.hudson.plugins.extended__choice__parameter.ExtendedChoiceParameterDefinition in new
-- com.sonyericsson.rebuild.RebuildSettings in old
- <scm class="hudson.plugins.git.GitSCM"></scm> in new has more options
-- userRemoteConfigs <refspec> in new
-- branches /master and master
- build:
-- buildStepFailureThreshold +
-- unstableThreshold: FAILURE 2 RED and UNSTABLE 1 YELLOW
-- failureThreshold +
-- hudson.tasks.Shell +
- email:
-- recipientList +
-- <hudson.plugins.emailext.plugins.trigger.FailureTrigger>:
--- replyTo in old
--- contentType in old
-- defaultContent +
-- compressBuildLog>true</compressBuildLog> in old
-- *<deleteDirs>false</deleteDirs>
in old, because in new:
wrappers:
- !include: './maxscale_jobs/include/workspace-cleanup-total.yaml'

#10 Updated by Ilfat Kinyaev about 5 years ago

  • Status changed from Active / In progress to Review
  • Assignee changed from Ilfat Kinyaev to Mark Zaslavskiy
  • % Done changed from 60 to 100
  • Test scenario updated (diff)

#11 Updated by Ilfat Kinyaev about 5 years ago

  • Test scenario updated (diff)

#12 Updated by Mark Zaslavskiy about 5 years ago

  • Status changed from Review to New
  • Assignee changed from Mark Zaslavskiy to Ilfat Kinyaev

Please
- add all needed file from the https://github.com/mariadb-corporation/maxscale-jenkins-jobs repo to mdbci/jobs because now job can not be validated.
- fix comments

#13 Updated by Ilfat Kinyaev about 5 years ago

  • Status changed from New to Active / In progress

#14 Updated by Ilfat Kinyaev about 5 years ago

When check validate:
../jjg/scripts/validate_yaml.sh jobs/mdbci_integration_test.yaml

INFO:root:Will use anonymous access to Jenkins if needed.
INFO:jenkins_jobs.local_yaml:Including file './jobs/include/boxes.yaml' from path '.'
INFO:jenkins_jobs.local_yaml:Including file './jobs/include/products.yaml' from path '.'
INFO:jenkins_jobs.local_yaml:Including file './jobs/include/versions.yaml' from path '.'
INFO:jenkins_jobs.local_yaml:Including file './jobs/include/do_not_destroy_vm.yaml' from path '.'
INFO:jenkins_jobs.local_yaml:Including file './jobs/include/last_modified_branch_detection/mdbci_branch.yaml' from path '.'
INFO:jenkins_jobs.local_yaml:Including file './jobs/include/mdbci_integration_test/scm.yaml' from path '.'
INFO:jenkins_jobs.local_yaml:Including file './jobs/include/workspace-cleanup-total.yaml' from path '.'
INFO:jenkins_jobs.local_yaml:Including file './jobs/include/mdbci_integration_test/publishers.yaml' from path '.'
INFO:jenkins_jobs.local_yaml:Including file './jobs/include/mdbci_integration_test/email_body' from path '.'
Traceback (most recent call last):
File "/usr/local/bin/jenkins-jobs", line 11, in <module>
sys.exit(main())
File "/usr/local/lib/python2.7/dist-packages/jenkins_jobs/cmd.py", line 172, in main
execute(options, config)
File "/usr/local/lib/python2.7/dist-packages/jenkins_jobs/cmd.py", line 338, in execute
output=options.output_dir)
File "/usr/local/lib/python2.7/dist-packages/jenkins_jobs/builder.py", line 317, in update_job
self.parser.generateXML()
File "/usr/local/lib/python2.7/dist-packages/jenkins_jobs/parser.py", line 312, in generateXML
self.xml_jobs.append(self.getXMLForJob(job))
File "/usr/local/lib/python2.7/dist-packages/jenkins_jobs/parser.py", line 322, in getXMLForJob
self.gen_xml(xml, data)
File "/usr/local/lib/python2.7/dist-packages/jenkins_jobs/parser.py", line 329, in gen_xml
module.gen_xml(self, xml, data)
File "/usr/local/lib/python2.7/dist-packages/jenkins_jobs/modules/parameters.py", line 685, in gen_xml
parser, pdefs, param)
File "/usr/local/lib/python2.7/dist-packages/jenkins_jobs/registry.py", line 186, in dispatch
if name in eps:
TypeError: unhashable type: 'list'
INFO:jenkins_jobs.builder:Cache saved

#15 Updated by Ilfat Kinyaev about 5 years ago

  • Status changed from Active / In progress to Review
  • Assignee changed from Ilfat Kinyaev to Mark Zaslavskiy
  • % Done changed from 100 to 70

#16 Updated by pytift bot about 5 years ago

Test success

#17 Updated by pytift bot about 5 years ago

Test success

#18 Updated by pytift bot about 5 years ago

Test success

#19 Updated by Mark Zaslavskiy about 5 years ago

  • Assignee changed from Mark Zaslavskiy to Tatyana Berlenko

#20 Updated by pytift bot about 5 years ago

Test success

#21 Updated by pytift bot about 5 years ago

Test success

#22 Updated by pytift bot about 5 years ago

Test success

#23 Updated by pytift bot about 5 years ago

Test success

#24 Updated by Mark Zaslavskiy about 5 years ago

  • Assignee changed from Tatyana Berlenko to Alexander Kaluzhny

#25 Updated by Alexander Kaluzhny about 5 years ago

  • Status changed from Review to New
  • Assignee changed from Alexander Kaluzhny to Ilfat Kinyaev

INFO:root:Will use anonymous access to Jenkins if needed.
INFO:jenkins_jobs.local_yaml:Including file './jobs/include/boxes.yaml' from path '.'
INFO:jenkins_jobs.local_yaml:Including file './jobs/include/products.yaml' from path '.'
INFO:jenkins_jobs.local_yaml:Including file './jobs/include/versions.yaml' from path '.'
INFO:jenkins_jobs.local_yaml:Including file './jobs/include/do_not_destroy_vm.yaml' from path '.'
INFO:jenkins_jobs.local_yaml:Including file './jobs/include/last_modified_branch_detection/mdbci_branch.yaml' from path '.'
INFO:jenkins_jobs.local_yaml:Including file './jobs/include/mdbci_integration_test/scm.yaml' from path '.'
INFO:jenkins_jobs.local_yaml:Including file './jobs/include/workspace-cleanup-total.yaml' from path '.'
INFO:jenkins_jobs.local_yaml:Including file './jobs/include/mdbci_integration_test/publishers.yaml' from path '.'
INFO:jenkins_jobs.local_yaml:Including file './jobs/include/mdbci_integration_test/email_body' from path '.'
Traceback (most recent call last):
File "/usr/local/bin/jenkins-jobs", line 11, in <module>
sys.exit(main())
File "/usr/local/lib/python2.7/dist-packages/jenkins_jobs/cmd.py", line 172, in main
execute(options, config)
File "/usr/local/lib/python2.7/dist-packages/jenkins_jobs/cmd.py", line 338, in execute
output=options.output_dir)
File "/usr/local/lib/python2.7/dist-packages/jenkins_jobs/builder.py", line 317, in update_job
self.parser.generateXML()
File "/usr/local/lib/python2.7/dist-packages/jenkins_jobs/parser.py", line 312, in generateXML
self.xml_jobs.append(self.getXMLForJob(job))
File "/usr/local/lib/python2.7/dist-packages/jenkins_jobs/parser.py", line 322, in getXMLForJob
self.gen_xml(xml, data)
File "/usr/local/lib/python2.7/dist-packages/jenkins_jobs/parser.py", line 329, in gen_xml
module.gen_xml(self, xml, data)
File "/usr/local/lib/python2.7/dist-packages/jenkins_jobs/modules/parameters.py", line 685, in gen_xml
parser, pdefs, param)
File "/usr/local/lib/python2.7/dist-packages/jenkins_jobs/registry.py", line 186, in dispatch
if name in eps:
TypeError: unhashable type: 'list'
INFO:jenkins_jobs.builder:Cache saved

Error connected to include's. So almost all includes have hyphen and files that they include does not need hyphen.

#26 Updated by Ilfat Kinyaev about 5 years ago

  • Status changed from New to Active / In progress

#27 Updated by Ilfat Kinyaev about 5 years ago

  • Status changed from Active / In progress to New

#28 Updated by Mark Zaslavskiy about 5 years ago

  • Assignee changed from Ilfat Kinyaev to Tatyana Berlenko

#29 Updated by Ilfat Kinyaev almost 5 years ago

  • Status changed from New to Active / In progress
  • Assignee changed from Tatyana Berlenko to Ilfat Kinyaev

#30 Updated by Ilfat Kinyaev almost 5 years ago

  • Status changed from Active / In progress to Review
  • Assignee changed from Ilfat Kinyaev to Mark Zaslavskiy
  • % Done changed from 70 to 90

#31 Updated by Mark Zaslavskiy almost 5 years ago

  • Status changed from Review to Closed

Also available in: Atom PDF