Project

Profile

Help

Task #6604

Implement setup_repo command for all recipes and providers

Added by Kirill Yudenok almost 5 years ago. Updated over 4 years ago.

Status:
Closed
Priority:
Normal
Category:
mdbci features
Sprint/Milestone:
Start date:
14.12.2015
Due date:
10.02.2016
% Done:

100%

Estimated time:
2:00 h
Spent time:
Target branch:
Test scenario:

Description

- implement ./mdbci install_repo maxscale config/node - for setup maxscale repo to running vm

Base command -- ./mdbci install_repo <product> config/node

P.S. first implementation for Maxscale product, then for other (mariadb, galera, ...)


Related issues

Related to [mdbci] Maria DB Continuous integration tool - Feature #6593: install Maxscale repositories to running VMClosed10.12.201525.01.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to [mdbci] Maria DB Continuous integration tool - Task #6608: Test and debug mdbci install_repo command for all providersDuplicated15.12.201525.01.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to [mdbci] Maria DB Continuous integration tool - Task #6605: Implement mdbci update product command to running VMClosed14.12.201525.01.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to [mdbci] Maria DB Continuous integration tool - Task #6649: Implement install_repo command for mdbci type of boxesClosed19.01.201625.01.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to [mdbci] Maria DB Continuous integration tool - Task #6661: Implement Maxscale install_product command for all providersClosed29.01.201610.02.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>
Related to [mdbci] Maria DB Continuous integration tool - Task #6701: Create function for access to repo.dClosed03.02.2016

<a title="Actions" class="icon-only icon-actions js-contextmenu" href="#">Actions</a>

History

#1 Updated by Kirill Yudenok almost 5 years ago

  • Related to Feature #6593: install Maxscale repositories to running VM added

#2 Updated by Kirill Yudenok almost 5 years ago

  • Estimated time set to 2:00 h

- use public_keys mdbci command as a template for this command
- create install_repo command, that copy repo to nodes platform
- repo file path different for nodes platforms (ubuntu, centos, ...)

#3 Updated by Kirill Yudenok almost 5 years ago

  • Related to Task #6608: Test and debug mdbci install_repo command for all providers added

#4 Updated by Kirill Yudenok almost 5 years ago

  • Status changed from Assigned to Active / In progress

#5 Updated by Kirill Yudenok almost 5 years ago

  • Status changed from Active / In progress to Pull request

#6 Updated by Kirill Yudenok almost 5 years ago

  • Status changed from Pull request to Resolved

#7 Updated by Kirill Yudenok over 4 years ago

  • Status changed from Resolved to Testing
  • Assignee changed from Kirill Yudenok to Timofey Turenko

#8 Updated by Kirill Yudenok over 4 years ago

  • Status changed from Testing to Pull request

#9 Updated by Kirill Yudenok over 4 years ago

  • Status changed from Pull request to Testing
  • % Done changed from 0 to 100

#10 Updated by Kirill Krinkin over 4 years ago

  • Status changed from Testing to Reopened
  • Sprint/Milestone changed from 0.72 to 0.82

#11 Updated by Kirill Krinkin over 4 years ago

  • Sprint/Milestone changed from 0.82 to 0.83

#12 Updated by Kirill Krinkin over 4 years ago

  • Sprint/Milestone changed from 0.83 to 0.82

#13 Updated by Kirill Yudenok over 4 years ago

  • Status changed from Reopened to Active / In progress

#14 Updated by Kirill Yudenok over 4 years ago

  • Status changed from Active / In progress to Pull request
  • Assignee changed from Timofey Turenko to Alexander Kaluzhny

#15 Updated by Kirill Yudenok over 4 years ago

  • Status changed from Reopened to Active / In progress

#16 Updated by Kirill Yudenok over 4 years ago

  • Status changed from Pull request to Reopened

#17 Updated by Kirill Yudenok over 4 years ago

  • Related to Task #6605: Implement mdbci update product command to running VM added

#18 Updated by Kirill Yudenok over 4 years ago

  • Due date set to 25.01.2016
  • Assignee changed from Alexander Kaluzhny to Kirill Yudenok
  • implement command for mdbci boxes
  • code review and test

#19 Updated by Kirill Yudenok over 4 years ago

  • Related to Task #6649: Implement install_repo command for mdbci type of boxes added

#20 Updated by Kirill Yudenok over 4 years ago

  • Sprint/Milestone changed from 0.82 to 0.83

#21 Updated by Kirill Yudenok over 4 years ago

  • Status changed from Active / In progress to Pull request
  • Assignee changed from Kirill Yudenok to Alexander Kaluzhny

#22 Updated by Kirill Yudenok over 4 years ago

  • Sprint/Milestone changed from 0.83 to 0.82

#23 Updated by Kirill Yudenok over 4 years ago

  • Status changed from Pull request to Testing
  • Assignee changed from Alexander Kaluzhny to Timofey Turenko

#24 Updated by Timofey Turenko over 4 years ago

  • Status changed from Testing to Reopened
  • Assignee changed from Timofey Turenko to Kirill Yudenok

https://github.com/OSLL/mdbci/pull/67 can't be merged because of conflicts!

#25 Updated by Kirill Yudenok over 4 years ago

  • Status changed from Reopened to Testing
  • Assignee changed from Kirill Yudenok to Timofey Turenko
  • conflicts fixed.

#26 Updated by Kirill Yudenok over 4 years ago

  • Timofey, mdbci nodes require to add NOPASSWD:ALL for mdbci node user to /etc/sudoers file
  • This is need for ssh command to mdbci node by user:ip

#27 Updated by Timofey Turenko over 4 years ago

what is the relation between NOPASSWD requirement and this task?

#28 Updated by Kirill Yudenok over 4 years ago

ssh don't work without it and always ask password. I didn't find another solution.

#29 Updated by Timofey Turenko over 4 years ago

  • Status changed from Testing to Reopened
  • Assignee changed from Timofey Turenko to Kirill Yudenok

Please add detailed documentation.

From 'mdbci' short halp:

mdbci install_repo --product maxscale T/node0

Does it mean that command './mdbci install_repo --product maxscale build_centos_6.5_libvirt-20160126-0627/build --repo-dir ~/repo_play/repo.d/' installs Maxscale repository to the machine?

Trying with empty machine:

vagrant@ns3014560:~/mdbci$ ./mdbci install_repo --product maxscale build_centos_6.5_libvirt-20160126-0627/build --repo-dir ~/repo_play/repo.d/
INFO: MariaDb CI CLI
INFO: mdbci called with: ["install_repo", "build_centos_6.5_libvirt-20160126-0627/build"]
INFO: Checking this machine configuration requirments
INFO: .....NOT IMPLEMENTED YET
INFO: Load Boxes from ./BOXES
INFO: Loaded boxes: 35
INFO: Load AWS config from aws-config.yml
INFO: Load Repos from /home/vagrant/repo_play/repo.d/
INFO: Looking up for repos /home/vagrant/repo_play/repo.d/
INFO: Loaded repos: 17
INFO: Load nodes from template file build_centos_6.5_libvirt-20160126-0627.json
INFO: Looking for repo
INFO: Repo key is packages@default+centos^6 ... NOT_FOUND
ERROR: No such product for this node!

crash:

vagrant@ns3014560:~/mdbci$ ./mdbci install_repo --product maxscale release-1.3.0-centos6/maxscale --repo-dir /repo_play/repo.d/
INFO: MariaDb CI CLI
INFO: mdbci called with: ["install_repo", "release-1.3.0-centos6/maxscale"]
INFO: Checking this machine configuration requirments
INFO: .....NOT IMPLEMENTED YET
INFO: Load Boxes from ./BOXES
INFO: Loaded boxes: 35
INFO: Load AWS config from aws-config.yml
INFO: Load Repos from /home/vagrant/repo_play/repo.d/
INFO: Looking up for repos /home/vagrant/repo_play/repo.d/
INFO: Loaded repos: 17
INFO: Load nodes from template file release-1.3.0-centos6.json
INFO: Looking for repo
INFO: Repo key is maxscale@default+centos^6 ... FOUND
/home/vagrant/mdbci/core/node_product.rb:161:in `installProductRepo': undefined method `loadNodePlatformBy' for #<Session:0x00000001e57800> (NoMethodError)
from /home/vagrant/mdbci/core/session.rb:269:in `commands'
from ./mdbci:87:in `<main>'
vagrant@ns3014560:
/mdbci$

crash in case if machine is not specified:

vagrant@ns3014560:~/mdbci$ ./mdbci install_repo --product maxscale release-1.3.0-centos6 --repo-dir /repo_play/repo.d/
INFO: MariaDb CI CLI
INFO: mdbci called with: ["install_repo", "release-1.3.0-centos6"]
INFO: Checking this machine configuration requirments
INFO: .....NOT IMPLEMENTED YET
INFO: Load Boxes from ./BOXES
INFO: Loaded boxes: 35
INFO: Load AWS config from aws-config.yml
INFO: Load Repos from /home/vagrant/repo_play/repo.d/
INFO: Looking up for repos /home/vagrant/repo_play/repo.d/
INFO: Loaded repos: 17
INFO: Load nodes from template file release-1.3.0-centos6.json
INFO: Looking for repo
INFO: Repo key is +centos^7 ... NOT_FOUND
ERROR: No such product for this node!
INFO: Looking for repo
INFO: Repo key is +centos^7 ... NOT_FOUND
ERROR: No such product for this node!
INFO: Looking for repo
INFO: Repo key is +centos^7 ... NOT_FOUND
ERROR: No such product for this node!
INFO: Looking for repo
INFO: Repo key is +centos^7 ... NOT_FOUND
ERROR: No such product for this node!
INFO: Looking for repo
INFO: Repo key is +centos^7 ... NOT_FOUND
ERROR: No such product for this node!
INFO: Looking for repo
INFO: Repo key is +centos^7 ... NOT_FOUND
ERROR: No such product for this node!
INFO: Looking for repo
INFO: Repo key is +centos^7 ... NOT_FOUND
ERROR: No such product for this node!
INFO: Looking for repo
INFO: Repo key is +centos^7 ... NOT_FOUND
ERROR: No such product for this node!
INFO: Looking for repo
INFO: Repo key is maxscale@default+centos^6 ... FOUND
/home/vagrant/mdbci/core/node_product.rb:141:in `block in installProductRepo': undefined method `loadNodePlatformBy' for #<Session:0x000000012ae828> (NoMethodError)
from /home/vagrant/mdbci/core/node_product.rb:138:in `each'
from /home/vagrant/mdbci/core/node_product.rb:138:in `installProductRepo'
from /home/vagrant/mdbci/core/session.rb:269:in `commands'
from ./mdbci:87:in `<main>'
vagrant@ns3014560:
/mdbci$

#30 Updated by Kirill Yudenok over 4 years ago

  • Yes, it must work.
  • I think you are testing with merged 6655 branch where loadNodePlatformBy() was removed. Tomorrow I will check this moment.

#31 Updated by Kirill Yudenok over 4 years ago

  • Subject changed from Implement mdbci install repo command to running VM to Implement Maxscale setup_repo command for all providers
  • Due date changed from 25.01.2016 to 01.02.2016
  • Status changed from Reopened to Active / In progress
  • % Done changed from 100 to 50

- combine install_repo and udpate_repo commands to setup_repo command for Maxscale product;

#32 Updated by Kirill Yudenok over 4 years ago

  • Related to Task #6661: Implement Maxscale install_product command for all providers added

#33 Updated by Kirill Yudenok over 4 years ago

  • Status changed from Active / In progress to Pull request
  • Assignee changed from Kirill Yudenok to Alexander Kaluzhny
  • % Done changed from 50 to 100

Pull request for code review: https://github.com/OSLL/mdbci/pull/67

#34 Updated by Alexander Kaluzhny over 4 years ago

  • Status changed from Pull request to Testing
  • Assignee changed from Alexander Kaluzhny to Timofey Turenko

#35 Updated by Mark Zaslavskiy over 4 years ago

  • Sprint/Milestone changed from 0.82 to 0.83

#36 Updated by Timofey Turenko over 4 years ago

  • Status changed from Testing to Reopened
./mdbci setup_repo --product maxscale --repo-dir /home/vagrant/.jenkins/jobs/upgrade_test/workspace/repo.d install_centos_7.0_libvirt-20160203-1209/build
....
 INFO:  Repo key is packages@default+centos^7 ... NOT_FOUND
ERROR:  No such product for this node!

repo for wrong product is installed ('packages' instead of 'maxscale')

as discussed, additional parameter is needed - version of the product. If it is missing - latest major version should be configured (e.g. for MariaDB 10.1)

#37 Updated by Mark Zaslavskiy over 4 years ago

  • Assignee changed from Timofey Turenko to Kirill Yudenok

#38 Updated by Mark Zaslavskiy over 4 years ago

  • Status changed from Reopened to New

#39 Updated by Kirill Yudenok over 4 years ago

  • Status changed from New to Active / In progress

#40 Updated by Kirill Yudenok over 4 years ago

  • Status changed from Active / In progress to New

#41 Updated by Kirill Yudenok over 4 years ago

  • Subject changed from Implement Maxscale setup_repo command for all providers to Implement setup_repo command for all recipes and providers
  • Category set to mdbci features
  • Status changed from New to Active / In progress
  • % Done changed from 100 to 50
  • test command on ubuntu and centos, suse fails on update because found not valid key

#42 Updated by Kirill Yudenok over 4 years ago

  • Related to Task #6701: Create function for access to repo.d added

#43 Updated by Kirill Yudenok over 4 years ago

  • Status changed from Active / In progress to New

#44 Updated by Mark Zaslavskiy over 4 years ago

  • Assignee changed from Kirill Yudenok to Alexander Kaluzhny

#45 Updated by Timofey Turenko over 4 years ago

  • Due date changed from 01.02.2016 to 10.02.2016

#46 Updated by Alexander Kaluzhny over 4 years ago

  • Status changed from New to Active / In progress
  • % Done changed from 50 to 80

#47 Updated by Alexander Kaluzhny over 4 years ago

  • Status changed from Active / In progress to Pull request
  • Assignee changed from Alexander Kaluzhny to Mark Zaslavskiy
  • % Done changed from 80 to 100

#48 Updated by Alexander Kaluzhny over 4 years ago

  • Status changed from Pull request to Testing
  • Assignee changed from Mark Zaslavskiy to Alexander Kaluzhny
  • % Done changed from 100 to 90

#49 Updated by Alexander Kaluzhny over 4 years ago

  • Status changed from Testing to Pull request
  • Assignee changed from Alexander Kaluzhny to Mark Zaslavskiy
  • % Done changed from 90 to 100

Alexander Kaluzhny wrote:

Pull request, started testing http://maxscale-jenkins.mariadb.com:8090/job/mdbci_integration_test/150/

Wrong task - testing is for 6661

#50 Updated by Alexander Kaluzhny over 4 years ago

  • Status changed from Pull request to Review

#51 Updated by Mark Zaslavskiy over 4 years ago

  • Status changed from Review to Testing

#52 Updated by Mark Zaslavskiy over 4 years ago

  • Assignee changed from Mark Zaslavskiy to Timofey Turenko

#53 Updated by Timofey Turenko over 4 years ago

  • Status changed from Testing to Reopened

integration + 6631 + 6604:

./mdbci setup_repo --product maxscale --repo-dir /home/vagrant/.jenkins/jobs/upgrade_test/workspace/repo.d install_centos_7.0_libvirt-20160210-1159/build
/home/vagrant/mdbci/core/node_product.rb:157:in `setupProductRepo': undefined method `[]' for nil:NilClass (NoMethodError)
from /home/vagrant/mdbci/core/session.rb:288:in `commands'
from ./mdbci:91:in `<main>'
INFO: MariaDb CI CLI
INFO: mdbci called with: ["setup_repo", "install_centos_7.0_libvirt-20160210-1159/build"]
INFO: Checking this machine configuration requirments
INFO: .....NOT IMPLEMENTED YET
INFO: Load Boxes from ./BOXES
INFO: Loaded boxes: 35
INFO: Load AWS config from aws-config.yml
INFO: Load Repos from /home/vagrant/.jenkins/jobs/upgrade_test/workspace/repo.d
INFO: Looking up for repos /home/vagrant/.jenkins/jobs/upgrade_test/workspace/repo.d
WARN: Invalid file format: /home/vagrant/.jenkins/jobs/upgrade_test/workspace/repo.d/mysql/ubuntu/5.6.json SKIPPED!
WARN: Invalid file format: /home/vagrant/.jenkins/jobs/upgrade_test/workspace/repo.d/mysql/ubuntu/5.7-dmr.json SKIPPED!
INFO: Loaded repos: 759
INFO: Load nodes from template file install_centos_7.0_libvirt-20160210-1159.json

http://max-tst-01.mariadb.com:8089/view/test/job/upgrade_test/8/console

#54 Updated by Mark Zaslavskiy over 4 years ago

./mdbci setup_repo --product maxscale --repo-dir /home/vagrant/.jenkins/jobs/upgrade_test/workspace/repo.d install_centos_7.0_libvirt-20160210-1159/build
/home/vagrant/mdbci/core/node_product.rb:157:in `setupProductRepo': undefined method `[]' for nil:NilClass (NoMethodError)
    from /home/vagrant/mdbci/core/session.rb:288:in `commands'
    from ./mdbci:91:in `<main>'
 INFO:  MariaDb CI CLI
 INFO:  mdbci called with: ["setup_repo", "install_centos_7.0_libvirt-20160210-1159/build"]
 INFO:  Checking this machine configuration requirments
 INFO:  .....NOT IMPLEMENTED YET
 INFO:  Load Boxes from ./BOXES
 INFO:  Loaded boxes: 35
 INFO:  Load AWS config from aws-config.yml
 INFO:  Load Repos from /home/vagrant/.jenkins/jobs/upgrade_test/workspace/repo.d
 INFO:  Looking up for repos /home/vagrant/.jenkins/jobs/upgrade_test/workspace/repo.d
 WARN:  Invalid file format: /home/vagrant/.jenkins/jobs/upgrade_test/workspace/repo.d/mysql/ubuntu/5.6.json SKIPPED!
 WARN:  Invalid file format: /home/vagrant/.jenkins/jobs/upgrade_test/workspace/repo.d/mysql/ubuntu/5.7-dmr.json SKIPPED!
 INFO:  Loaded repos: 759
 INFO:  Load nodes from template file install_centos_7.0_libvirt-20160210-1159.json

#55 Updated by Mark Zaslavskiy over 4 years ago

  • Assignee changed from Timofey Turenko to Kirill Yudenok

#56 Updated by Mark Zaslavskiy over 4 years ago

  • Status changed from Reopened to New

#57 Updated by Mark Zaslavskiy over 4 years ago

  • Assignee changed from Kirill Yudenok to Alexander Kaluzhny

#58 Updated by Alexander Kaluzhny over 4 years ago

  • Status changed from New to Active / In progress

#59 Updated by Timofey Turenko over 4 years ago

  • Status changed from Active / In progress to Merge

error https://dev.osll.ru/issues/6604#note-54 caused by wrong node name.
This issue is tracked by https://dev.osll.ru/issues/6746

This one can be integrated.

#60 Updated by Mark Zaslavskiy over 4 years ago

  • Assignee changed from Alexander Kaluzhny to Mark Zaslavskiy

#61 Updated by Timofey Turenko over 4 years ago

  • Status changed from Merge to Closed

merged, closing

Also available in: Atom PDF