Monday, 2019-06-03

*** AOjeaGarcia__ has quit IRC02:13
*** jhesketh has joined #airshipit02:53
*** anyrude10_ has quit IRC03:01
*** aojea has joined #airshipit03:19
*** aojea has quit IRC03:20
*** AOjeaGarcia has joined #airshipit03:20
*** cheng1 has quit IRC04:12
*** cheng1 has joined #airshipit04:17
*** altlogbot_1 has quit IRC04:36
*** altlogbot_1 has joined #airshipit04:36
*** jamesgu_ has quit IRC05:07
*** jamesgu_ has joined #airshipit05:13
*** weystrom has joined #airshipit05:35
*** roman_g has joined #airshipit06:00
*** nmimi has joined #airshipit06:25
*** pgaxatte has joined #airshipit06:29
*** weystrom_ has joined #airshipit06:30
*** weystrom has quit IRC06:33
*** jamesgu_ has quit IRC06:57
*** nick_kar has joined #airshipit07:06
*** mika1 has joined #airshipit07:12
*** mika1 has left #airshipit07:13
*** mikkos has joined #airshipit07:20
*** nmimi has quit IRC07:24
*** kskels has quit IRC07:41
*** jbryce has quit IRC07:41
*** mnaser has quit IRC07:41
*** mattmceuen has quit IRC07:41
*** mugsie has quit IRC07:41
*** evrardjp has quit IRC07:41
*** irclogbot_3 has quit IRC07:44
*** irclogbot_2 has joined #airshipit07:44
*** anvaad has joined #airshipit07:47
*** dasp has quit IRC07:47
*** portdirect has quit IRC07:47
*** mikkos has left #airshipit07:49
*** mikkos has joined #airshipit07:50
mikkosexit07:50
*** mikkos has quit IRC07:50
*** dasp has joined #airshipit07:52
*** portdirect has joined #airshipit07:52
*** kskels has joined #airshipit07:53
*** jbryce has joined #airshipit07:53
*** mnaser has joined #airshipit07:53
*** mattmceuen has joined #airshipit07:53
*** mugsie has joined #airshipit07:53
*** evrardjp has joined #airshipit07:53
*** mikkos has joined #airshipit07:56
*** jaakko has joined #airshipit08:05
*** anvaad has quit IRC08:14
*** mikkos has quit IRC08:17
*** mikkos has joined #airshipit08:30
*** happyhemant has joined #airshipit08:31
*** anvaad has joined #airshipit08:31
anvaadHello,08:32
anvaadIs there any channel where I can discuss troublshooting issues with 'Airship in a Bottle'08:32
*** nmimi has joined #airshipit08:38
*** mikkos has quit IRC08:57
jaakkoThere is http://lists.airshipit.org/pipermail/airship-discuss/ where some issues are discussed09:45
*** weystrom_ has quit IRC09:47
*** mikkos has joined #airshipit09:47
*** weystrom has joined #airshipit09:57
*** weystrom_ has joined #airshipit09:58
*** weystrom has quit IRC10:02
roman_ganvaad: this one10:08
*** weystrom_ has quit IRC10:42
*** mikkos has left #airshipit10:46
*** mikkos has joined #airshipit10:46
*** arunkant has quit IRC10:59
*** arunkant has joined #airshipit10:59
anvaadthanks roman_g11:01
anvaadI have encouted two issues while running kubeclt on the vm11:01
anvaad1. kubectl create -f mypod.yaml --> error: the path "mypod.yaml" does not exist11:02
anvaad2. kubectl edit pod somepod_name ----> error: unable to launch the editor "vi"11:02
anvaadTried searching the archives here http://lists.airshipit.org/pipermail/airship-discuss/, to no avail11:03
anvaadI was wondering if anybody has encouted this11:03
*** pkaralis has joined #airshipit11:28
*** alexanderhughes has joined #airshipit12:02
*** arunkant has quit IRC12:32
*** arunkant has joined #airshipit12:32
*** jbryce has quit IRC12:43
*** portdirect has quit IRC12:44
*** jbryce has joined #airshipit12:46
*** bh526r has joined #airshipit12:46
*** kskels has quit IRC12:48
*** kskels has joined #airshipit12:49
*** aaronsheffield has joined #airshipit12:55
*** portdirect has joined #airshipit12:58
*** anvaad has quit IRC13:08
*** arunkant has quit IRC13:10
*** arunkant has joined #airshipit13:11
*** arunkant has quit IRC13:13
*** nishantkr has joined #airshipit13:13
*** arunkant has joined #airshipit13:14
*** kranthikirang has joined #airshipit13:16
*** sthussey has joined #airshipit13:18
*** howell has joined #airshipit13:21
*** arunkant has quit IRC13:23
*** arunkant has joined #airshipit13:24
*** sreejithp has joined #airshipit13:27
roman_ganvaad, 1. means that file you refer to can not be found in current directory.13:30
roman_ganvaad, 2. means that you need to install vi editor, or change EDITOR variable in your shell so that it points to editor installed on your system (e.g. vim or nano)13:31
*** kguttikonda has joined #airshipit13:32
*** happyhemant has quit IRC13:33
*** mnaser has quit IRC13:34
*** kranthikirang has quit IRC13:34
*** happyhemant has joined #airshipit13:35
*** arunkant has quit IRC13:35
*** arunkant has joined #airshipit13:36
*** mnaser has joined #airshipit13:37
mikkosroman_g, 1. mypod.yaml exist and error occurs even with absolute path13:40
*** arunkant has quit IRC14:04
*** arunkant has joined #airshipit14:04
*** arunkant has quit IRC14:07
kguttikonda@team, any idea where should we define sr-iov interfaces for neutron ?14:07
*** arunkant has joined #airshipit14:08
kguttikondaI see openstack-helm does support SR-IOV14:08
*** michael-beaver has joined #airshipit14:17
*** openstackgerrit has joined #airshipit14:17
openstackgerritMatt McEuen proposed airship/promenade master: Change CoreDNS from Deployment to DaemonSet  https://review.opendev.org/66244814:17
openstackgerritMichael Beaver proposed airship/shipyard master: Remove required-projects from Airskiff gate  https://review.opendev.org/66228414:22
openstackgerritRahul Khiyani proposed airship/promenade master: ETCD: Add pod/container security context  https://review.opendev.org/66233414:25
roman_gmikkos: more background would help. Where is that mypod.yaml from?14:29
openstackgerritAlexander Hughes proposed airship/pegleg master: [WIP] Update tests dir to use yaml.safe_load()  https://review.opendev.org/66276914:30
roman_gI can't find anything in Airship what could refer to to mypod.yaml file.14:30
*** jamesgu_ has joined #airshipit14:30
mikkosroman_g: The content of yaml file does not matter, it fails even with simple deployment yaml example14:36
*** pgaxatte has quit IRC14:40
*** arunkant has quit IRC14:43
*** arunkant has joined #airshipit14:44
*** mikkos has quit IRC14:45
roman_gmikkos, can you please exlplain why you think this is this a problem in Airship? For me it doesn't seem to be so.14:51
roman_gMay be I'm missing something.14:51
*** sreejithp has quit IRC14:56
*** AOjeaGarcia has quit IRC15:07
*** irclogbot_2 has quit IRC15:10
openstackgerritRoman Gorshunov proposed airship/treasuremap master: Add cross-verification of Git commit ID'd and image tags  https://review.opendev.org/66100415:10
*** irclogbot_2 has joined #airshipit15:10
*** altlogbot_1 has quit IRC15:11
*** altlogbot_0 has joined #airshipit15:11
*** arunkant has quit IRC15:12
*** arunkant has joined #airshipit15:12
*** sgrasley_ has quit IRC15:16
openstackgerritAlexander Hughes proposed airship/pegleg master: [WIP] Update Pegleg base image to use Ubuntu 18.04 (Bionic Beaver)  https://review.opendev.org/66108815:17
openstackgerritKudaka Poorna Rajesh proposed airship/promenade master: [WIP] Add deploy promenade gate check  https://review.opendev.org/66260515:20
openstackgerritIan Pittwood proposed airship/spyglass-plugin-xls master: Adds force option to manifest generation  https://review.opendev.org/66203415:22
alexanderhughesdid I miss a conversation on renaming airship/in-a-bottle to airship/airship-in-a-bottle ?15:31
*** dasp has quit IRC15:35
evgenylalexanderhughes: This has been discussed quite a few times here and on ML.15:37
openstackgerritAlexander Hughes proposed airship/pegleg master: [WIP} Update AIAB repo names  https://review.opendev.org/66279015:40
openstackgerritAlexander Hughes proposed airship/pegleg master: [WIP} Update AIAB repo names  https://review.opendev.org/66279015:41
*** sreejithp has joined #airshipit15:44
*** dasp has joined #airshipit15:53
openstackgerritAlexander Hughes proposed airship/pegleg master: Update AIAB repo names  https://review.opendev.org/66279015:59
openstackgerritAlexander Hughes proposed airship/pegleg master: [WIP] Update tests dir to use yaml.safe_load()  https://review.opendev.org/66276916:02
openstackgerritAlexander Hughes proposed airship/pegleg master: [WIP] Update Pegleg base image to use Ubuntu 18.04 (Bionic Beaver)  https://review.opendev.org/66108816:05
openstackgerritAlexander Hughes proposed airship/pegleg master: [WIP]Use Promenade enc key in Genesis Bundle  https://review.opendev.org/66227116:06
*** arunkant has quit IRC16:16
openstackgerritAlexander Hughes proposed airship/pegleg master: Update tests dir to use yaml.safe_load()  https://review.opendev.org/66276916:21
openstackgerritMerged airship/pegleg master: Update AIAB repo names  https://review.opendev.org/66279016:44
*** bh526r has quit IRC16:46
openstackgerritMerged airship/armada master: Add ubuntu_xenial image build to Armada  https://review.opendev.org/66256516:52
openstackgerritMerged airship/spyglass master: Adds Safety dependency vulnerability checks  https://review.opendev.org/65885416:54
openstackgerritAlexander Hughes proposed airship/pegleg master: Added cleartext option to passphrase generation  https://review.opendev.org/64501717:12
openstackgerritMichael Beaver proposed airship/shipyard master: Remove required-projects from Airskiff gate  https://review.opendev.org/66228417:14
openstackgerritAlexander Hughes proposed airship/pegleg master: Added cleartext option to passphrase generation  https://review.opendev.org/64501717:17
openstackgerritAlexander Hughes proposed airship/pegleg master: Added cleartext option to passphrase generation  https://review.opendev.org/64501717:40
*** AlexNoskov has joined #airshipit17:43
evgenylAlexNoskov:  hey, kskels wanted to help with treasuremap uplift.17:46
openstackgerritIan Pittwood proposed airship/pegleg master: Adds Safety dependency vulnerability checks  https://review.opendev.org/66281217:46
*** anvaad has joined #airshipit18:17
*** anvaad has quit IRC18:18
*** kranthikirang has joined #airshipit18:41
*** altlogbot_0 has quit IRC18:43
*** altlogbot_0 has joined #airshipit18:43
*** kguttikonda has quit IRC18:44
*** kranthikirang has quit IRC18:50
*** kranthikirang has joined #airshipit18:51
openstackgerritEvgeniy L proposed airship/treasuremap master: [WIP] Uplift nfs-provisioner  https://review.opendev.org/66258318:51
openstackgerritKaspars Skels proposed airship/armada master: Correct Armada github sync key  https://review.opendev.org/66282318:57
*** kranthikirang has quit IRC19:00
*** op317q__ has joined #airshipit19:03
op317q__hii19:03
op317q__I need help with Mass Ingress19:03
op317q__it is failing19:03
op317q__Matt and Kasper suggested me to post my question here19:04
op317q__this ubuntu@mtn15r06o002:~$ sudo kubectl logs --namespace="ucp" maas-ingress-errors-5988bbbdcb-ttj5j + COMMAND=start + [ xstart == xstart ] + [[ -z 8080 ]] + exec /server -port 808019:04
op317q__using airsloop for deployment19:09
openstackgerritKaspars Skels proposed airship/treasuremap master: Uplift all components except Drydock, Armada & Promenade  https://review.opendev.org/66208519:11
*** altlogbot_0 has quit IRC19:21
op317q__any body for Airsloop deployment19:21
op317q__any thing that can help to resol19:21
op317q__this issue19:21
evgenylop317q__: How do you determine that ingress-error pod is failing? What is the status of the pod?19:22
*** altlogbot_0 has joined #airshipit19:25
openstackgerritMichael Beaver proposed airship/shipyard master: Remove required-projects from Airskiff gate  https://review.opendev.org/66228419:32
op317q__ucp           maas-ingress-errors-5988bbbdcb-ttj5j                        1/1       Running     0          4h        10.97.139.90    mtn15r06o002   <none>19:37
op317q__ucp           maas-rack-0                                                 1/1       Running     0          4h        172.29.131.11   mtn15r06o002   <none>19:37
op317q__ucp           maas-region-0                                               2/2       Running     0          4h        10.97.139.100   mtn15r06o002   <none>19:37
op317q__ucp           mariadb-ingress-78987d559c-hdkpj                            1/1       Running     0          4h        10.97.139.96    mtn15r06o002   <none>19:37
op317q__ucp           mariadb-ingress-error-pages-56ffbf595b-cfgxc                1/1       Running     0          4h        10.97.139.95    mtn15r06o002   <none>19:37
op317q__ucp           mariadb-server-0                                            1/1       Running     0          4h        10.97.139.98    mtn15r06o002   <none>19:37
op317q__the reason is that Drydock is able to boot the server19:37
op317q__but after the boot it is not able to find the node19:38
op317q__I see here is that ipmi session is able to connect the server and rebooted it  . this I observed it when I open the terminal for XXXXXXXX but after the boot , it is not able to locate it .19:39
op317q__19:39
op317q__Any thought ?19:39
op317q__19:39
op317q__2019-06-03 15:32:23,441 - DEBUG - oob.py:70:exec_ipmi_command Initializing IPMI session19:39
op317q__2019-06-03 15:32:23,441 - DEBUG - oob.py:54:get_ipmi_session Starting IPMI session to XXXXXXXXX with root/A19:39
op317q__2019-06-03 15:32:23,459 - DEBUG - oob.py:84:exec_ipmi_command Calling IPMI command get_power on XXXXXXXX19:39
op317q__2019-06-03 15:32:23,462 - DEBUG - oob.py:326:start XXXXXXXXXXXXX reports powerstate of off19:39
op317q__2019-06-03 15:32:23,463 - DEBUG - oob.py:346:start Sending set_power = on command to XXXXXXXX19:39
op317q__2019-06-03 15:32:23,463 - DEBUG - oob.py:70:exec_ipmi_command Initializing IPMI session19:39
op317q__2019-06-03 15:32:23,463 - DEBUG - oob.py:54:get_ipmi_session Starting IPMI session to XXXXXXXX with root/A19:39
op317q__2019-06-03 15:32:23,500 - DEBUG - oob.py:84:exec_ipmi_command Calling IPMI command set_power on XXXXXXXX19:40
op317q__2019-06-03 15:32:23,506 - DEBUG - oob.py:70:exec_ipmi_command Initializing IPMI session19:40
op317q__2019-06-03 15:32:23,506 - DEBUG - oob.py:54:get_ipmi_session Starting IPMI session to XXXXXXXXX with root/A19:40
evgenylI'm trying to understand, how maas-ingress-errors-5988bbbdcb-ttj5j is related to drydock problems?19:40
evgenylop317q__: Can you please use https://paste.ubuntu.com/ or http://paste.openstack.org/ for pasting the logs?19:41
evgenylop317q__: And what do you exactly mean when you say "it is not able to locate it"? How do you determine this?19:42
op317q__@Evgeny below line says it19:43
op317q__2019-06-03 15:32:34,365 - INFO - machine.py:609:identify_baremetal_node Could not locate node XXXXXXXX in MaaS19:43
op317q__after session Starting IPMI session to XXXXXXXXX  , it tries to locate the node and it gets above error19:44
evgenylop317q__: Is this server present in MaaS?19:44
op317q__it should be .. How to verify this19:45
evgenylop317q__: it has INFO logging level, it may be not an error, but a part of normal flow.19:45
evgenylop317q__: I don't know if MaaS UI was removed, try logging it into it, or use MaaS cli.19:46
op317q__I checked the MASS ui from the genesis node , and I don't see the compute node (XXXXXX) in the list19:47
evgenylop317q__: Do you see any other nodes prensent?19:48
op317q__then I am able to login using PXE IP to this compute node19:48
op317q__no19:48
evgenylHave you seen drydock reporting an actual error? Or is it still tries to provision the node?19:49
op317q__tt still tries to provision the node19:50
op317q__do I have to change boot prefe19:51
op317q__boot perference19:51
evgenylop317q__: does it try to reboot the node on every retry?19:51
op317q__no only once19:51
evgenylop317q__: What is the status of the node? Is it powere on/off?19:51
openstackgerritIan Pittwood proposed airship/spyglass master: [WIP] Implements data object models  https://review.opendev.org/66209219:51
op317q__it is on19:51
op317q__it had previous OS that I installed to find all the nic19:52
openstackgerritIan Pittwood proposed airship/spyglass master: Pin dependency versions  https://review.opendev.org/66245319:53
evgenylop317q__: Are you sure that it is booted in previous version of the OS? A few things to try, 1. Make sure that you have a higher priority for booting from network in BIOS 2. You can try powering off the node, to see if it  is turned on by drydock on the next retry.19:54
op317q__yes19:55
op317q__I was monitoring19:55
op317q__let me try it19:55
op317q__I need connect to VPN for this19:55
op317q__and then come back and update you19:55
evgenyl1st suggestion is the most important, you need to make sure that when node is booted, it tries to boot over the network and not from the disk.19:56
openstackgerritAlexander Hughes proposed airship/pegleg master: [WIP] Site and global secret decrypt.  https://review.opendev.org/66284719:59
openstackgerritIan Pittwood proposed airship/spyglass master: Manifest undefined data validation  https://review.opendev.org/65568320:01
*** kranthikirang has joined #airshipit20:06
*** mattmceuen__ has joined #airshipit20:07
*** mugsie_ has joined #airshipit20:09
*** evrardjp_ has joined #airshipit20:09
openstackgerritAlexander Hughes proposed airship/pegleg master: [WIP] Site and global secret decrypt.  https://review.opendev.org/66284720:13
op317q__Hi Evgeny L20:14
op317q__I power off the machine and put the next boot PXE20:14
op317q__Drydock booted the system20:14
op317q__and the system tried to boot from PXE20:14
op317q__it was not able then It went to normal boot20:15
*** mattmceuen has quit IRC20:15
*** mugsie has quit IRC20:15
*** evrardjp has quit IRC20:15
*** mattmceuen__ is now known as mattmceuen20:15
evgenylWe still have a problem with hanging maas-import-resource in our AIAB, I looked a bit closer and it mostly related to failing attempts of maas-rack pod to register, here are the failures https://paste.ubuntu.com/p/9r8fYfcPfb/ , the config looks just fine and when I run `maas-rack register --url=http://10.0.2.6:30001/MAAS --secret=<SEC>` in the same container, it finishes without problems, mattmceuen maybe you know some maas20:19
evgenylexpert who may have some info on that?20:19
evgenylIs Anthony on irc? I'm wondering if this is somehow related to this change https://review.opendev.org/#/c/662312/20:20
op317q__Evgeny my issue is related to this issue ?20:21
op317q__or different issue ?20:21
evgenylop317q__: No, it is not related.20:21
op317q__ok20:22
evgenylop317q__: I'm not a MaaS pro, so I myself trying to understand how all this works...20:22
op317q__ok20:23
evgenylop317q__: When your node gets booted by drydock, as far as I know, it should boot over PXE, it's hard to tell why it does not. You can try checking the traffic with tcpdump to make sure that DHCP requests come to your server.20:24
openstackgerritIan Pittwood proposed airship/spyglass master: Schema validation  https://review.opendev.org/65917220:26
openstackgerritIan Pittwood proposed airship/spyglass master: Schema validation  https://review.opendev.org/65917220:33
op317q__ok20:33
openstackgerritAlexander Hughes proposed airship/pegleg master: [WIP] Site and global secret decrypt.  https://review.opendev.org/66284720:39
nishantkr evgenyl: I am unable to open the link to the failure logs but from your description it sounds like similar issue we have seen in maas and worked upon by Anthony, I am aware of the following PS which were used to address the issue:20:40
nishantkrhttps://review.opendev.org/#/c/662336/20:40
nishantkrhttps://review.opendev.org/#/c/662312/20:40
openstackgerritMichael Beaver proposed airship/shipyard master: Remove required-projects from Airskiff gate  https://review.opendev.org/66228420:40
openstackgerritIan Pittwood proposed airship/spyglass master: Data objects for Spyglass  https://review.opendev.org/65891720:42
evgenylnishantkr: In the logs there is a traceback `OSError: [Errno 22] Invalid argument: '/etc/maas/rackd.conf'` after the execution of `maas-rack register ...` command and it retries it.20:42
openstackgerritAlexander Hughes proposed airship/pegleg master: [WIP] Site and global secret decrypt.  https://review.opendev.org/66284720:42
evgenylnishantkr: Thank you Nishant, I will try to use these patches to see if this helps.20:43
*** altlogbot_0 has quit IRC20:45
nishantkrevgenyl: Don't think that was the error we saw,  from what i remember  maas-import-resources job never got completed as sync job failed on one of the nodes and the job was stuck in a loop and specifically that issue was seen in a BF scenario and not GF20:47
evgenylnishantkr: Oh, I see, thanks for letting me know!20:48
openstackgerritEvgeniy L proposed airship/treasuremap master: Uplift MaaS to fix stabilitiy issues  https://review.opendev.org/66285520:56
openstackgerritStas Egorov proposed airship/airship-in-a-bottle master: Support for new hyperkube source in promenade  https://review.opendev.org/65795420:57
kskelsevgenyl: me and op317q__ looked at the PXE interface - it looks like VLAN is not correctly configured20:58
openstackgerritEvgeniy L proposed airship/treasuremap master: [WIP] Uplift nfs-provisioner  https://review.opendev.org/66258320:58
kskelsso I have suggested to check with the lab folks to make sure the network/VLAN is OK for PXE20:58
evgenylkskels: Oh, I see, thanks!21:00
*** sreejithp has quit IRC21:04
kskelshttps://www.irccloud.com/pastebin/mI3yAT3H/21:04
kskelsswilkers: seeing chart failure for elasticsearch in latest uplift21:05
kskelslet me know if this seems familiar21:05
kskelssrwilkers:21:06
srwilkersnot familiar21:08
srwilkersgood place to start looking would be here: details = "render error in "elasticsearch/statefulset-data.yaml": template: elasticsearch/statefulset-data.yaml:142:32: executing "elasticsearch/statefulset-data.yaml" at <.Values.conf.elastic...>: can't evaluate field data in type interface {}"21:08
evgenylkskels: can you also check tiller logs, maybe there will be a bit more info?21:09
srwilkersid be willing to bet it's due to this: https://github.com/airshipit/treasuremap/blob/master/global/software/charts/osh-infra/osh-infra-logging/elasticsearch.yaml#L304-L30521:10
kskelshttps://www.irccloud.com/pastebin/jz0UBq1E/21:10
srwilkersnot matching this: https://github.com/openstack/openstack-helm-infra/blob/master/elasticsearch/values.yaml#L657-L66121:10
*** jaakko has quit IRC21:11
kskelslet me update!21:11
srwilkersi also expect you to run into issues with the fluent-logging chart if you attempt to uplift it, since it no longer exists21:12
kskelsdo you think best would be to skip uplifting OSH until you can help with fixes?21:12
kskelsmaybe osh-infra team could craft an uplift patchset for this..21:12
srwilkersat some point maybe, but not going to be anytime soon21:13
srwilkerssince it's effectively just me21:13
srwilkersand i've got a massive backlog atm :(21:13
mattmceuenor srwilkers, is there a PS to osh-infra that has analogous override changes?21:13
kskelsexactly..21:13
srwilkerswe've always had this in tree: https://github.com/openstack/openstack-helm-infra/blob/master/tools/deployment/armada/manifests/armada-lma.yaml21:14
srwilkersthat gets updated with the changes we make21:14
srwilkersthat would be your best bet -- it's a bit difficult for us to maintain multiple manifests spread across multiple repos unfortunately21:14
kskelsthank you21:14
srwilkersyou're welcome21:15
openstackgerritMerged airship/armada master: Correct Armada github sync key  https://review.opendev.org/66282321:19
openstackgerritMichael Beaver proposed airship/shipyard master: Remove required-projects from Airskiff gate  https://review.opendev.org/66228421:20
*** howell has quit IRC21:24
openstackgerritKaspars Skels proposed airship/treasuremap master: Uplift most of the Airship components  https://review.opendev.org/66286021:30
*** kranthikirang has quit IRC21:33
*** alexanderhughes has quit IRC21:47
*** nishantkr has quit IRC21:58
openstackgerritMichael Beaver proposed airship/shipyard master: Remove required-projects from Airskiff gate  https://review.opendev.org/66228422:16
*** aaronsheffield has quit IRC22:53
*** sthussey has quit IRC23:33

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!