Thursday, 2019-04-11

*** sgrasley_ has joined #airshipit00:30
*** sgrasley has quit IRC00:32
*** kukacz_ has quit IRC00:32
*** kukacz has joined #airshipit00:33
*** kaspars__ has quit IRC01:41
*** mbeierl has quit IRC01:47
*** sthussey has quit IRC02:11
*** kranthikirang has quit IRC02:51
*** kaspars__ has joined #airshipit03:01
openstackgerritKaspars Skels proposed openstack/airship-treasuremap master: [wip] Add sloop type and airsloop site  https://review.openstack.org/64919503:15
openstackgerritKaspars Skels proposed openstack/airship-treasuremap master: [wip] Add sloop type and airsloop site  https://review.openstack.org/64919503:30
*** jamesgu has quit IRC04:01
*** lemko has joined #airshipit04:59
*** kaspars__ has quit IRC06:51
*** lemko has quit IRC07:09
*** sgrasley_ has quit IRC07:27
*** Nishant_ has joined #airshipit07:39
*** happyhemant has joined #airshipit07:42
*** mbologna_ has quit IRC07:50
*** mbologna has joined #airshipit07:51
*** lemko has joined #airshipit08:10
openstackgerritDmitrii Kabanov proposed openstack/airship-divingbell master: Add support of older versions of GO  https://review.openstack.org/65173309:21
*** Nishant_ has quit IRC09:49
*** aaronsheffield has joined #airshipit12:55
*** kranthikirang has joined #airshipit13:41
*** ianychoi has quit IRC14:13
*** ianychoi has joined #airshipit14:14
*** kaspars__ has joined #airshipit14:26
openstackgerritKaspars Skels proposed openstack/airship-treasuremap master: [wip] Add sloop type and airsloop site  https://review.openstack.org/64919514:41
openstackgerritRahul Khiyani proposed openstack/airship-promenade master: [DNM]Add pod/container security context  https://review.openstack.org/63918914:47
openstackgerritMerged openstack/airship-promenade master: Revert "remove /etc/genesis post armada bootstrap"  https://review.openstack.org/65164614:54
openstackgerritIan Pittwood proposed openstack/airship-spyglass master: [WIP] Resolves Bandit 104 errors  https://review.openstack.org/65180714:59
openstackgerritRick Bartra proposed openstack/airship-drydock master: Add CIDR validation for MAAS  https://review.openstack.org/64878115:01
*** sthussey has joined #airshipit15:05
openstackgerritKaspars Skels proposed openstack/airship-treasuremap master: [WIP] Create pipeline for airsloop site  https://review.openstack.org/64943215:05
openstackgerritAlexander Hughes proposed openstack/airship-pegleg master: [WIP] Ensure cryptostrings contain all char types  https://review.openstack.org/65181215:10
kranthikirangkaspars__: I am at the step to deploy nodes; MAAS commissioned the master nodes and in process to deploy them. I am seeing at console that all servers are trying to fetch following from MAAS API and retries; http://10.23.20.11:30000/api/v1.0/bootactions/nodes/mtn21c-node-02/files15:20
kranthikirangKaspars__: When I look into maas-rack-0 I see following error: http://paste.openstack.org/show/749190/15:22
kranthikirangCan you help over here?15:22
kranthikirangfrom drydock I see an error: http://paste.openstack.org/show/749191/15:23
openstackgerritRick Bartra proposed openstack/airship-drydock master: Add CIDR validation for MAAS  https://review.openstack.org/64878115:23
kaspars__Generally, when a new node is done deploying as a last step it will call back to MAAS to get bootactions (mainly promenade.join) which is then bootstrapping Kubernetes, etc15:24
kaspars__MAAS is then calling to promenade to get the actual bootaction for promenade - can you also check promenade logs if you see any error there15:25
kranthikirangkaspars__: I see an error but not sure if that is relevant;  http://paste.openstack.org/show/749192/15:28
openstackgerritRahul Khiyani proposed openstack/airship-promenade master: [DNM]Add pod/container security context  https://review.openstack.org/63918915:29
kranthikirangkaspars_: looks like promenade didn't bootstrap totally in my setup?15:31
kaspars__yes - that is exactly the error as you are running behind proxy15:31
kaspars__so while generating initial bootaction promenade is pulling k8s binary " HTTPSConnectionPool(host='dl.k8s.io', port=443): Max retries exceeded with url: /v1.11.6/kubernetes-node-linux-amd64.tar.gz "15:31
kaspars__so you will need to set proxy for promenade pod15:32
kaspars__https://github.com/openstack/airship-treasuremap/blob/master/site/airship-seaworthy/software/charts/ucp/promenade/promenade.yaml#L2115:32
kaspars__here is commented out section that you can enable - you will need to update your chart though for this to take effect15:33
kranthikirangkaspars_: I thought Airship supports proxy; I did put the proxy in manifests; Do we have to explicitly pass proxy values to promenade?15:33
kaspars__yes, you do - see the link I shared15:33
kranthikirangkaspars_: Ok; There is anyway I can upgrade the promenade help chart instead of rebuild everything?15:33
kranthikiranghelm chart *15:33
kranthikirangor do I have to redo genesis ?15:35
kaspars__there is a way to update YAMLs and use armada directly..15:35
kaspars__maybe we could create some troubleshooting/tips document sometime15:35
kaspars__I think it's a little bit too much to get into15:35
kranthikirangthat would be appropriate; there is no documentation on how to upgrade or redeploy with changes ..etc15:36
kaspars__it's much more streamlined when the site is up - updating genesis directly is not exactly in path of normal operations15:36
kaspars__but I agree - something we could work towards some document for troubleshooting/tips15:37
kranthikirangok; What do you suggest me now? Update manifests and redeploy ?15:37
kranthikirangI though putting proxy in common-addresses.yaml would be sufficient;15:39
kaspars__no, that mostly covers few aspects.. so definetely you may think of how more broader proxy support could be implemented15:40
kranthikiranghttps://review.openstack.org/#/c/649155/ - this is for promenade client while creating the bundle else it will fail; Please review it15:40
kaspars__yes, that's a good example where proxy bits need to be injected15:41
kaspars__I do think we should likely create a version of this script in airship-treasuremap/tools15:41
kaspars__but not completely sure - this looks good to me15:41
kranthikirangkaspars__: Ok, please review it; Looks like I have missed updating proxy totally in promenade site specs;15:43
kranthikirangkaspars_: We should give a way to find NEWSITE_CHANGEME all places: I have missed this one15:43
kaspars__https://github.com/openstack/airship-treasuremap/blob/master/site/airship-seaworthy/software/charts/ucp/promenade/promenade.yaml#L2115:44
kaspars__looks like it is there already, isn't it?15:44
kranthikirangyeah, exactly15:44
kranthikirangI will re-do and let you know15:44
openstackgerritScott Hussey proposed openstack/airship-promenade master: (apiserver) [WIP] support key rotation  https://review.openstack.org/63193515:48
kranthikirangkaspars_: any idea what would be no_proxy values? other than  .cluster.local?15:48
kaspars__"10.96.0.1,.cluster.local" - and maybe add some localhost, and 127.0.0.115:49
kaspars__I think those should be sufficient15:49
kranthikirangI mean w.r.t ip addresses; don't think subnet will work for no_proxy 10.96.0.0/1615:50
kranthikirangkaspars_: ok15:50
openstackgerritDimitrios Markou proposed openstack/airship-treasuremap master: [WIP] Create documentation for airsloop site  https://review.openstack.org/65165215:57
openstackgerritIan Pittwood proposed openstack/airship-spyglass master: [WIP] Resolve Bandit 605 error  https://review.openstack.org/65182315:57
openstackgerritIan Pittwood proposed openstack/airship-spyglass master: Remove flask YAML web editor from Spyglass  https://review.openstack.org/65099315:59
openstackgerritRick Bartra proposed openstack/airship-drydock master: Add CIDR validation for MAAS  https://review.openstack.org/64878116:00
openstackgerritAlexander Hughes proposed openstack/airship-pegleg master: [WIP] Ensure cryptostrings contain all char types  https://review.openstack.org/65181216:04
openstackgerritkranthi kiran guttikonda proposed openstack/airship-treasuremap master: promenade_api proxy input correction  https://review.openstack.org/65182616:05
openstackgerritAlexander Hughes proposed openstack/airship-pegleg master: [WIP] Ensure cryptostrings contain all char types  https://review.openstack.org/65181216:16
openstackgerritkranthi kiran guttikonda proposed openstack/airship-treasuremap master: promenade_api proxy input correction  https://review.openstack.org/65182616:17
*** ianychoi has quit IRC16:20
openstackgerritAlexander Hughes proposed openstack/airship-pegleg master: [WIP] Ensure cryptostrings contain all char types  https://review.openstack.org/65181216:20
openstackgerritDmitrii Kabanov proposed openstack/airship-divingbell master: Add support of older versions of GO  https://review.openstack.org/65173316:27
openstackgerritIan Pittwood proposed openstack/airship-spyglass master: [WIP] Resolve Bandit 605 error  https://review.openstack.org/65182317:03
openstackgerritCraig Anderson proposed openstack/airship-promenade master: Allow certgen independent of bundle creation  https://review.openstack.org/63729117:56
*** kranthikirang has quit IRC18:02
*** bh526r has joined #airshipit18:06
openstackgerritAlexander Hughes proposed openstack/airship-pegleg master: Ensure cryptostrings contain all char types  https://review.openstack.org/65181218:18
openstackgerritCraig Anderson proposed openstack/airship-divingbell master: Use common logger for consistent log output  https://review.openstack.org/63681618:18
*** happyhemant has quit IRC18:21
openstackgerritAlexander Hughes proposed openstack/airship-pegleg master: Ensure cryptostrings contain all char types  https://review.openstack.org/65181218:23
openstackgerritAlexander Hughes proposed openstack/airship-spyglass master: Various fixes to Spyglass to resolve tox errors  https://review.openstack.org/64876418:41
openstackgerritAlexander Hughes proposed openstack/airship-spyglass master: Various fixes to Spyglass to resolve tox errors  https://review.openstack.org/64876418:57
openstackgerritKaspars Skels proposed openstack/airship-treasuremap master: [wip] Add sloop type and airsloop site  https://review.openstack.org/64919519:15
openstackgerritDmitrii Kabanov proposed openstack/airship-divingbell master: Add support of older versions of Helm  https://review.openstack.org/65173319:23
openstackgerritKaspars Skels proposed openstack/airship-treasuremap master: [wip] Add sloop type and airsloop site  https://review.openstack.org/64919519:38
openstackgerritMerged openstack/airship-shipyard master: User context tracing through logging  https://review.openstack.org/63387319:41
openstackgerritKaspars Skels proposed openstack/airship-treasuremap master: Add Pegleg and Promenade scripts to tools/  https://review.openstack.org/65191719:47
openstackgerritKaspars Skels proposed openstack/airship-treasuremap master: Add Pegleg, Promenade and Shipyard wrappers  https://review.openstack.org/65191719:53
*** kranthikirang has joined #airshipit20:10
openstackgerritKaspars Skels proposed openstack/airship-treasuremap master: [wip] Add sloop type and airsloop site  https://review.openstack.org/64919520:13
kranthikirangkaspars_: I see now following error: I guess this have to do with H/W profile for my HP gen9:20:14
kranthikirangBegin: Waiting for root file system ..Begin: Running /scripts/local-block. mdadm: CREATE group disk not found. mdadm: No devices listed in conf file were found20:15
kranthikirangI have following information in profile:20:16
kranthikirang## storage20:16
kranthikirang    # /dev/sda20:16
kranthikirang    bootdisk:20:16
kranthikirang      address: '0:1.0.0'20:16
kranthikirang      dev_type: 'PERC H710P'20:16
kranthikirang      bus_type: 'scsi'20:16
kranthikirang    # /dev/sdb20:16
kranthikirang    cephjournal1:20:16
kranthikirang      address: '0:1.0.1'20:16
kranthikirang      dev_type: 'PERC H710P'20:17
kranthikirang      bus_type: 'scsi'20:17
kranthikirang    # /dev/sdc20:17
kranthikirang    #cephjournal2:20:17
kranthikirang    #  address: '0:1.0.4'20:17
kranthikirang    #  dev_type: 'PERC H710P'20:17
kranthikirang    #  bus_type: 'scsi'20:17
kranthikirang    # /dev/sdc20:17
kranthikirang    ephemeral:20:17
kranthikirang      address: '0:1.0.4'20:17
kranthikirang      dev_type: 'PERC H710P'20:17
kranthikirang      bus_type: 'scsi'20:17
openstackgerritKaspars Skels proposed openstack/airship-treasuremap master: [wip] Add sloop type and airsloop site  https://review.openstack.org/64919520:17
kranthikirangI have used "lshw -c storage -c disk" command for "Physical id" which is address; not sure how to find dev_type? Any help?20:17
openstackgerritScott Hussey proposed openstack/airship-promenade master: (apiserver) [WIP] support key rotation  https://review.openstack.org/63193520:19
kranthikirangkaspars_: I have plan to use 1 SSD for ceph journal and 2 OSD(HDD)s per host;20:21
openstackgerritCraig Anderson proposed openstack/airship-divingbell master: Use common logger for consistent log output  https://review.openstack.org/63681620:23
kaspars__try running "sudo lshw -class disk" - I think it will give the info you need20:25
kaspars__e.g. bus info: scsi@0:2.0.020:26
kaspars__scsi is your type20:26
kaspars__I think the type is the same also for SSD disks20:26
kaspars__here in HW definitions - you basically write your aliases - you will later refer to them in the host profiles20:26
kranthikirangI thought scsi is a bus type20:27
kaspars__it is..20:27
kranthikirangso you mean  bootdisk:20:27
kranthikirang      address: '0:1.0.0'20:27
kranthikirang      dev_type: 'scsi'20:27
kranthikirang      bus_type: 'scsi'20:27
kaspars__looks like dev_type matches "product" section20:28
kaspars__I'm not really sure if dev_type is used really at the moment20:28
kaspars__no - I would use the product section for dev_type - not exactly sure if it's used or not20:28
kranthikirangOK;20:28
kranthikirangthen not sure why I am seeing this error20:28
kranthikirang Begin: Waiting for root file system ..Begin: Running /scripts/local-block. mdadm: CREATE group disk not found. mdadm: No devices listed in conf file were found20:28
kranthikirangin all 3 masters; deployment failed;20:29
kranthikirangand dropped into initramfs shell20:29
kranthikirangit shows product: LOGICAL VOLUME for all disks20:30
kranthikiranganyway if we are not using then less worried about that20:31
kranthikirangI am struck here, Any help would be really great20:31
openstackgerritDimitrios Markou proposed openstack/airship-treasuremap master: [WIP] Create documentation for airsloop site  https://review.openstack.org/65165220:59
*** bh526r has quit IRC21:06
openstackgerritEvgeniy L proposed openstack/airship-treasuremap master: Change default number of l3 agents from 5 to 3  https://review.openstack.org/63917921:19
openstackgerritEvgeniy L proposed openstack/airship-treasuremap master: Update docs to include generated certs into collected dir  https://review.openstack.org/63918121:20
openstackgerritDimitrios Markou proposed openstack/airship-treasuremap master: [WIP] Create documentation for airsloop site  https://review.openstack.org/65165221:22
openstackgerritEvgeniy L proposed openstack/airship-treasuremap master: Add metadata proxy shared secret for Nova and Neutron  https://review.openstack.org/63918321:23
openstackgerritEvgeniy L proposed openstack/airship-treasuremap master: Do not rerun promjoin on every reboot  https://review.openstack.org/64257121:23
openstackgerritDimitrios Markou proposed openstack/airship-treasuremap master: [WIP] Create documentation for airsloop site  https://review.openstack.org/65165221:24
*** lemko has quit IRC21:30
openstackgerritScott Hussey proposed openstack/airship-promenade master: (apiserver) [WIP] support key rotation  https://review.openstack.org/63193521:39
arunkantroman_g: Hi, did you got to review some of comments/feedback in airship multi-distro spec : https://review.openstack.org/#/c/643106/5/specs/approved/airship_multi_linux_distros.rst .May be updated patch is needed.21:48
openstackgerritDmitrii Kabanov proposed openstack/airship-drydock master: Add possibility to check response code in auth test  https://review.openstack.org/65193322:17
openstackgerritKaspars Skels proposed openstack/airship-treasuremap master: [wip] Add sloop type and airsloop site  https://review.openstack.org/64919522:18
openstackgerritDmitrii Kabanov proposed openstack/airship-drydock master: Add possibility to check response code in auth test  https://review.openstack.org/65193522:21
*** aaronsheffield has quit IRC23:14
*** kukacz has quit IRC23:21
*** roman_g has quit IRC23:21
*** nick_kar has quit IRC23:21
openstackgerritSreejith Punnapuzha proposed openstack/airship-promenade master: [fix] etcd backup to use different filename  https://review.openstack.org/64874523:22
*** kukacz has joined #airshipit23:27
*** roman_g has joined #airshipit23:27
*** nick_kar has joined #airshipit23:27
*** kranthikirang has quit IRC23:27
openstackgerritPRATEEK REDDY DODDA proposed openstack/airship-deckhand master: Implement Security Context for Deckhand  https://review.openstack.org/63920423:47
openstackgerritPRATEEK REDDY DODDA proposed openstack/airship-armada master: Implement Security Context for Armada  https://review.openstack.org/63920723:53

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!