| *** agopi|brb has quit IRC | 00:01 | |
| *** rlandy is now known as rlandy|bbl | 00:01 | |
| *** itlinux has joined #tripleo | 00:03 | |
| *** hamzy_ has joined #tripleo | 00:05 | |
| *** mjturek has quit IRC | 00:06 | |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
|---|---|---|
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 00:10 |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 00:10 |
| *** agopi|brb has joined #tripleo | 00:25 | |
| *** agopi|brb is now known as agopi | 00:27 | |
| *** ade_lee has joined #tripleo | 00:28 | |
| *** rh-jelabarre has quit IRC | 00:35 | |
| *** rh-jelabarre has joined #tripleo | 00:40 | |
| *** rh-jelabarre has quit IRC | 00:54 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 01:10 |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 01:10 |
| *** bugzy_ has joined #tripleo | 01:30 | |
| *** mrsoul has joined #tripleo | 01:32 | |
| *** bugzy has quit IRC | 01:33 | |
| *** flaper87 has quit IRC | 01:37 | |
| *** ade_lee has quit IRC | 01:37 | |
| *** d0ugal has quit IRC | 01:37 | |
| *** tristanC has quit IRC | 01:37 | |
| *** dtrainor has quit IRC | 01:37 | |
| *** mugsie has quit IRC | 01:37 | |
| *** jroll has quit IRC | 01:37 | |
| *** Tengu has quit IRC | 01:37 | |
| *** ajo has quit IRC | 01:37 | |
| *** odyssey4me has quit IRC | 01:37 | |
| *** bugzy_ has quit IRC | 01:37 | |
| *** agopi has quit IRC | 01:37 | |
| *** dmellado has quit IRC | 01:37 | |
| *** rlandy|bbl has quit IRC | 01:37 | |
| *** jhebden has quit IRC | 01:37 | |
| *** dmacpher_ has quit IRC | 01:37 | |
| *** Hobbestigrou has quit IRC | 01:37 | |
| *** zaneb has quit IRC | 01:37 | |
| *** csatari has quit IRC | 01:37 | |
| *** jbadiapa has quit IRC | 01:37 | |
| *** tzumainn has quit IRC | 01:37 | |
| *** spsurya has quit IRC | 01:37 | |
| *** sdake has quit IRC | 01:37 | |
| *** errr has quit IRC | 01:37 | |
| *** homegrown has quit IRC | 01:37 | |
| *** vkmc has quit IRC | 01:37 | |
| *** sdoran has quit IRC | 01:37 | |
| *** mgagne has quit IRC | 01:37 | |
| *** Ng has quit IRC | 01:37 | |
| *** StevenK has quit IRC | 01:37 | |
| *** hamzy_ has quit IRC | 01:37 | |
| *** sileht has quit IRC | 01:37 | |
| *** gouthamr has quit IRC | 01:37 | |
| *** mrunge has quit IRC | 01:37 | |
| *** ssbarnea_ has quit IRC | 01:37 | |
| *** KingJ has quit IRC | 01:37 | |
| *** zzzeek_ has quit IRC | 01:37 | |
| *** fpan has quit IRC | 01:37 | |
| *** bandini has quit IRC | 01:37 | |
| *** dr_gogeta86 has quit IRC | 01:37 | |
| *** beagles has quit IRC | 01:37 | |
| *** aedc has quit IRC | 01:37 | |
| *** sai_p has quit IRC | 01:37 | |
| *** florianf has quit IRC | 01:37 | |
| *** sshnaidm|afk has quit IRC | 01:37 | |
| *** jistr has quit IRC | 01:37 | |
| *** jpena|off has quit IRC | 01:37 | |
| *** PhilSliderS has quit IRC | 01:37 | |
| *** dtantsur|afk has quit IRC | 01:37 | |
| *** mfedosin has quit IRC | 01:37 | |
| *** thrash has quit IRC | 01:37 | |
| *** mwhahaha has quit IRC | 01:37 | |
| *** EmilienM has quit IRC | 01:37 | |
| *** Hazelesque has quit IRC | 01:37 | |
| *** rajinir has quit IRC | 01:37 | |
| *** panda has quit IRC | 01:37 | |
| *** agurenko has quit IRC | 01:37 | |
| *** zul has quit IRC | 01:37 | |
| *** artom has quit IRC | 01:37 | |
| *** abishop has quit IRC | 01:37 | |
| *** hjensas has quit IRC | 01:37 | |
| *** tbarron has quit IRC | 01:37 | |
| *** dhellmann has quit IRC | 01:37 | |
| *** Damjanek has quit IRC | 01:37 | |
| *** marios has quit IRC | 01:37 | |
| *** redrobot has quit IRC | 01:37 | |
| *** tonyb has quit IRC | 01:37 | |
| *** lennyb has quit IRC | 01:37 | |
| *** bnemec has quit IRC | 01:37 | |
| *** cgoncalves has quit IRC | 01:37 | |
| *** rook has quit IRC | 01:37 | |
| *** lhinds has quit IRC | 01:37 | |
| *** egonzalez has quit IRC | 01:37 | |
| *** fungi has quit IRC | 01:37 | |
| *** shadower has quit IRC | 01:37 | |
| *** mnasiadka has quit IRC | 01:37 | |
| *** melwitt has quit IRC | 01:37 | |
| *** marios|rover has quit IRC | 01:37 | |
| *** faceman has quit IRC | 01:37 | |
| *** therve has quit IRC | 01:37 | |
| *** jamesdenton has quit IRC | 01:37 | |
| *** PagliaccisCloud has quit IRC | 01:37 | |
| *** mnaser has quit IRC | 01:37 | |
| *** TheJulia has quit IRC | 01:37 | |
| *** itlinux has quit IRC | 01:37 | |
| *** chem` has quit IRC | 01:37 | |
| *** jaosorior has quit IRC | 01:37 | |
| *** bdodd_ has quit IRC | 01:37 | |
| *** iurygregory has quit IRC | 01:37 | |
| *** safchain has quit IRC | 01:37 | |
| *** dalvarez has quit IRC | 01:37 | |
| *** lucasagomes has quit IRC | 01:37 | |
| *** kopecmartin|ruck has quit IRC | 01:37 | |
| *** akrzos has quit IRC | 01:37 | |
| *** mrsoul has quit IRC | 01:37 | |
| *** mburned_out has quit IRC | 01:37 | |
| *** jjoyce has quit IRC | 01:37 | |
| *** ssbarnea has quit IRC | 01:37 | |
| *** mcarden has quit IRC | 01:37 | |
| *** weshay has quit IRC | 01:37 | |
| *** mmedvede has quit IRC | 01:37 | |
| *** rodrigods has quit IRC | 01:37 | |
| *** rnoriega has quit IRC | 01:37 | |
| *** nhicher has quit IRC | 01:37 | |
| *** percevalbot has quit IRC | 01:37 | |
| *** mandre has quit IRC | 01:37 | |
| *** spotz has quit IRC | 01:37 | |
| *** jillr has quit IRC | 01:37 | |
| *** Jeffrey4l has quit IRC | 01:37 | |
| *** pliu has quit IRC | 01:37 | |
| *** dansmith has quit IRC | 01:37 | |
| *** quiquell|off has quit IRC | 01:37 | |
| *** mschuppert has quit IRC | 01:37 | |
| *** owalsh_away has quit IRC | 01:37 | |
| *** mmethot has quit IRC | 01:37 | |
| *** matbu has quit IRC | 01:37 | |
| *** mjblack has quit IRC | 01:37 | |
| *** radez has quit IRC | 01:37 | |
| *** amoralej|off has quit IRC | 01:37 | |
| *** cschwede has quit IRC | 01:37 | |
| *** leifmadsen has quit IRC | 01:37 | |
| *** arxcruz has quit IRC | 01:37 | |
| *** toure has quit IRC | 01:37 | |
| *** gchamoul has quit IRC | 01:37 | |
| *** honza has quit IRC | 01:37 | |
| *** rickflare has quit IRC | 01:37 | |
| *** ansmith has quit IRC | 01:37 | |
| *** rcernin has quit IRC | 01:37 | |
| *** stevebaker has quit IRC | 01:37 | |
| *** jidar has quit IRC | 01:37 | |
| *** chandankumar has quit IRC | 01:37 | |
| *** ianw has quit IRC | 01:37 | |
| *** dsneddon_away has quit IRC | 01:37 | |
| *** numans has quit IRC | 01:37 | |
| *** bcafarel has quit IRC | 01:37 | |
| *** haleyb has quit IRC | 01:37 | |
| *** dpeacock has quit IRC | 01:37 | |
| *** mpjetta has quit IRC | 01:37 | |
| *** trown|outtypewww has quit IRC | 01:37 | |
| *** andreaf has quit IRC | 01:37 | |
| *** lblanchard has quit IRC | 01:37 | |
| *** naturalblue has quit IRC | 01:37 | |
| *** adrianreza has quit IRC | 01:37 | |
| *** rascasoft has quit IRC | 01:37 | |
| *** ericyoung has quit IRC | 01:37 | |
| *** ChanServ has quit IRC | 01:37 | |
| *** trown|outtypewww has joined #tripleo | 01:43 | |
| *** andreaf has joined #tripleo | 01:43 | |
| *** mpjetta has joined #tripleo | 01:43 | |
| *** dpeacock has joined #tripleo | 01:43 | |
| *** haleyb has joined #tripleo | 01:43 | |
| *** bcafarel has joined #tripleo | 01:43 | |
| *** dsneddon_away has joined #tripleo | 01:43 | |
| *** numans has joined #tripleo | 01:43 | |
| *** ianw has joined #tripleo | 01:43 | |
| *** chandankumar has joined #tripleo | 01:43 | |
| *** jidar has joined #tripleo | 01:43 | |
| *** stevebaker has joined #tripleo | 01:43 | |
| *** rcernin has joined #tripleo | 01:43 | |
| *** ansmith has joined #tripleo | 01:43 | |
| *** odyssey4me has joined #tripleo | 01:43 | |
| *** ajo has joined #tripleo | 01:43 | |
| *** Tengu has joined #tripleo | 01:43 | |
| *** jroll has joined #tripleo | 01:43 | |
| *** dtrainor has joined #tripleo | 01:43 | |
| *** d0ugal has joined #tripleo | 01:43 | |
| *** mugsie has joined #tripleo | 01:43 | |
| *** ade_lee has joined #tripleo | 01:43 | |
| *** honza has joined #tripleo | 01:43 | |
| *** toure has joined #tripleo | 01:43 | |
| *** arxcruz has joined #tripleo | 01:43 | |
| *** rickflare has joined #tripleo | 01:43 | |
| *** gchamoul has joined #tripleo | 01:43 | |
| *** leifmadsen has joined #tripleo | 01:43 | |
| *** amoralej|off has joined #tripleo | 01:43 | |
| *** cschwede has joined #tripleo | 01:43 | |
| *** radez has joined #tripleo | 01:43 | |
| *** mjblack has joined #tripleo | 01:43 | |
| *** matbu has joined #tripleo | 01:43 | |
| *** mmethot has joined #tripleo | 01:43 | |
| *** owalsh_away has joined #tripleo | 01:43 | |
| *** quiquell|off has joined #tripleo | 01:43 | |
| *** dansmith has joined #tripleo | 01:43 | |
| *** pliu has joined #tripleo | 01:43 | |
| *** Jeffrey4l has joined #tripleo | 01:43 | |
| *** jillr has joined #tripleo | 01:43 | |
| *** spotz has joined #tripleo | 01:43 | |
| *** mandre has joined #tripleo | 01:43 | |
| *** percevalbot has joined #tripleo | 01:43 | |
| *** nhicher has joined #tripleo | 01:43 | |
| *** rnoriega has joined #tripleo | 01:43 | |
| *** rodrigods has joined #tripleo | 01:43 | |
| *** mmedvede has joined #tripleo | 01:43 | |
| *** weshay has joined #tripleo | 01:43 | |
| *** mcarden has joined #tripleo | 01:43 | |
| *** ssbarnea has joined #tripleo | 01:43 | |
| *** jjoyce has joined #tripleo | 01:43 | |
| *** mburned_out has joined #tripleo | 01:43 | |
| *** mrsoul has joined #tripleo | 01:43 | |
| *** Ng has joined #tripleo | 01:44 | |
| *** StevenK has joined #tripleo | 01:44 | |
| *** card.freenode.net sets mode: +v Ng | 01:44 | |
| *** egonzalez has joined #tripleo | 01:44 | |
| *** bnemec has joined #tripleo | 01:44 | |
| *** cgoncalves has joined #tripleo | 01:44 | |
| *** rook has joined #tripleo | 01:44 | |
| *** lhinds has joined #tripleo | 01:44 | |
| *** fungi has joined #tripleo | 01:44 | |
| *** shadower has joined #tripleo | 01:44 | |
| *** mnasiadka has joined #tripleo | 01:44 | |
| *** melwitt has joined #tripleo | 01:44 | |
| *** hamzy_ has joined #tripleo | 01:44 | |
| *** sileht has joined #tripleo | 01:44 | |
| *** gouthamr has joined #tripleo | 01:44 | |
| *** mrunge has joined #tripleo | 01:44 | |
| *** ssbarnea_ has joined #tripleo | 01:44 | |
| *** KingJ has joined #tripleo | 01:44 | |
| *** zzzeek_ has joined #tripleo | 01:44 | |
| *** bandini has joined #tripleo | 01:44 | |
| *** fpan has joined #tripleo | 01:44 | |
| *** dr_gogeta86 has joined #tripleo | 01:44 | |
| *** beagles has joined #tripleo | 01:44 | |
| *** flaper87 has joined #tripleo | 01:44 | |
| *** lblanchard has joined #tripleo | 01:45 | |
| *** naturalblue has joined #tripleo | 01:45 | |
| *** adrianreza has joined #tripleo | 01:45 | |
| *** rascasoft has joined #tripleo | 01:45 | |
| *** ericyoung has joined #tripleo | 01:45 | |
| *** aedc has joined #tripleo | 01:45 | |
| *** sai_p has joined #tripleo | 01:45 | |
| *** mfedosin has joined #tripleo | 01:45 | |
| *** florianf has joined #tripleo | 01:45 | |
| *** sshnaidm|afk has joined #tripleo | 01:45 | |
| *** jistr has joined #tripleo | 01:45 | |
| *** jpena|off has joined #tripleo | 01:45 | |
| *** PhilSliderS has joined #tripleo | 01:45 | |
| *** dtantsur|afk has joined #tripleo | 01:45 | |
| *** rajinir has joined #tripleo | 01:45 | |
| *** thrash has joined #tripleo | 01:45 | |
| *** mwhahaha has joined #tripleo | 01:45 | |
| *** EmilienM has joined #tripleo | 01:45 | |
| *** card.freenode.net sets mode: +ovov mwhahaha mwhahaha EmilienM EmilienM | 01:45 | |
| *** Hazelesque has joined #tripleo | 01:45 | |
| *** zaneb has joined #tripleo | 01:45 | |
| *** csatari has joined #tripleo | 01:45 | |
| *** bugzy_ has joined #tripleo | 01:46 | |
| *** agopi has joined #tripleo | 01:46 | |
| *** dmellado has joined #tripleo | 01:46 | |
| *** rlandy|bbl has joined #tripleo | 01:46 | |
| *** jhebden has joined #tripleo | 01:46 | |
| *** dmacpher_ has joined #tripleo | 01:46 | |
| *** Hobbestigrou has joined #tripleo | 01:46 | |
| *** jamesdenton has joined #tripleo | 01:46 | |
| *** PagliaccisCloud has joined #tripleo | 01:46 | |
| *** mnaser has joined #tripleo | 01:46 | |
| *** TheJulia has joined #tripleo | 01:46 | |
| *** marios|rover has joined #tripleo | 01:46 | |
| *** faceman has joined #tripleo | 01:46 | |
| *** therve has joined #tripleo | 01:46 | |
| *** panda has joined #tripleo | 01:46 | |
| *** agurenko has joined #tripleo | 01:46 | |
| *** zul has joined #tripleo | 01:46 | |
| *** artom has joined #tripleo | 01:46 | |
| *** abishop has joined #tripleo | 01:46 | |
| *** hjensas has joined #tripleo | 01:46 | |
| *** tbarron has joined #tripleo | 01:46 | |
| *** dhellmann has joined #tripleo | 01:46 | |
| *** Damjanek has joined #tripleo | 01:46 | |
| *** marios has joined #tripleo | 01:46 | |
| *** redrobot has joined #tripleo | 01:46 | |
| *** tonyb has joined #tripleo | 01:46 | |
| *** lennyb has joined #tripleo | 01:46 | |
| *** chem` has joined #tripleo | 01:46 | |
| *** jaosorior has joined #tripleo | 01:46 | |
| *** bdodd_ has joined #tripleo | 01:46 | |
| *** safchain has joined #tripleo | 01:46 | |
| *** lucasagomes has joined #tripleo | 01:46 | |
| *** dalvarez has joined #tripleo | 01:46 | |
| *** kopecmartin|ruck has joined #tripleo | 01:46 | |
| *** akrzos has joined #tripleo | 01:46 | |
| *** card.freenode.net sets mode: +o jaosorior | 01:46 | |
| *** dmacpher_ has quit IRC | 01:46 | |
| *** agopi has quit IRC | 01:47 | |
| *** rlandy|bbl has quit IRC | 01:47 | |
| *** ChanServ has joined #tripleo | 01:47 | |
| *** card.freenode.net sets mode: +o ChanServ | 01:47 | |
| *** agopi has joined #tripleo | 01:49 | |
| *** mgagne has joined #tripleo | 01:49 | |
| *** rlandy has joined #tripleo | 01:49 | |
| *** dmacpher has joined #tripleo | 01:49 | |
| *** mcornea has joined #tripleo | 01:51 | |
| *** itlinux has joined #tripleo | 01:54 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 02:10 |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 02:10 |
| *** rlandy has quit IRC | 02:21 | |
| *** mcornea has quit IRC | 02:34 | |
| *** lblanchard has quit IRC | 02:56 | |
| *** ramishra has joined #tripleo | 02:57 | |
| *** psachin has joined #tripleo | 02:57 | |
| *** dtrainor has quit IRC | 02:59 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 03:10 |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 03:10 |
| *** jaganathan has joined #tripleo | 03:26 | |
| *** dtrainor has joined #tripleo | 03:35 | |
| *** dtrainor_ has joined #tripleo | 03:42 | |
| *** dtrainor_ has quit IRC | 03:43 | |
| *** dtrainor_ has joined #tripleo | 03:43 | |
| *** dtrainor has quit IRC | 03:43 | |
| *** udesale has joined #tripleo | 03:52 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 04:10 |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 04:10 |
| *** janki has joined #tripleo | 04:29 | |
| *** gkadam has joined #tripleo | 04:42 | |
| *** spsurya has joined #tripleo | 04:45 | |
| *** agurenko has quit IRC | 04:58 | |
| *** apetrich has joined #tripleo | 05:09 | |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 05:10 |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 05:10 |
| *** shyam89 has joined #tripleo | 05:11 | |
| *** ratailor has joined #tripleo | 05:11 | |
| *** slaweq has joined #tripleo | 05:11 | |
| *** quiquell|off is now known as quiquell | 05:22 | |
| quiquell | Good morning | 05:24 |
| ratailor | jaosorior, you around ? | 05:27 |
| *** jtomasek has joined #tripleo | 05:32 | |
| Tengu | hello tere | 05:34 |
| quiquell | Tengu: o/ | 05:34 |
| Tengu | how are you today, quiquell ? | 05:34 |
| quiquell | Tengu: Waittin for stuff to merge, but gates are broken now | 05:36 |
| Tengu | erf | 05:36 |
| Tengu | again | 05:36 |
| quiquell | Tengu: As always you can be of good help, did the coffe already arrive to your brains ? | 05:36 |
| Tengu | nope, wait, getting one XD | 05:36 |
| quiquell | Tengu: pasting random stuff here, you can start to read when you are coffed up | 05:37 |
| quiquell | So the issue at gates is at tripleo-puppet with nova_libvirt http://logs.openstack.org/45/560445/160/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/5d0f2b8/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-10-10_02_02_46 | 05:38 |
| quiquell | I see stuff like this Exec[set libvirt sasl credentials](provider=posix): Cannot understand environment setting \"TLS_PASSWORD=\"", | 05:39 |
| Tengu | ok, so that augeas thingy apparently | 05:40 |
| ratailor | Can anybody suggested, whether I should backport this https://review.openstack.org/#/c/557323/ to queens, as on this https://review.openstack.org/#/c/608581 lint is failing in queens, because of variable being used without explicit namespace in line#583 | 05:40 |
| Tengu | quiquell: lemme check the code, I see the Error is more in Error: /Stage[main]/Nova::Compute::Libvirt::Qemu/Augeas[qemu-conf-limits]: Could not evaluate: Saving failed, see debug | 05:40 |
| ratailor | or should I just remove the if block on line#583 and move on ? | 05:40 |
| Tengu | this is the failing thingy. the exec is just a warning. | 05:40 |
| quiquell | Tengu: maybe around this http://git.openstack.org/cgit/openstack/puppet-nova/tree/manifests/compute/libvirt/qemu.pp#n96 ? | 05:41 |
| quiquell | Tengu: this ssl thingy is new https://github.com/openstack/puppet-nova/commit/aa2893d7e07e0dc37935e602fcdbca99b102d35e | 05:41 |
| *** shyam89 has quit IRC | 05:42 | |
| Tengu | quiquell: well, there are 2 blocks with the same name, might be line 102 as well | 05:43 |
| *** agurenko has joined #tripleo | 05:43 | |
| quiquell | Tengu: So it cannot change qemu conf | 05:44 |
| Tengu | basically, yes. | 05:44 |
| quiquell | Tengu: we have also this '2018-10-10 01:58:35,216 ERROR: 25956 -- + mkdir -p /etc/puppet", ' | 05:44 |
| quiquell | Tengu: Maybe it cannot generated because there is no tls_password var | 05:45 |
| Tengu | 2s | 05:47 |
| Tengu | https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/nova/libvirt.pp#L113 | 05:48 |
| Tengu | wondering if this isn't an issue - but as said it's a warning. | 05:48 |
| Tengu | the real issue is the "Error" just following it. | 05:48 |
| quiquell | Tengu: Maybe it's a transitive dependency on it | 05:49 |
| Tengu | andof course we can't get the debug of augeas as is. | 05:49 |
| *** jbadiapa has joined #tripleo | 05:49 | |
| * Tengu starts his Beast | 05:49 | |
| Tengu | I'll re-play that run. | 05:50 |
| quiquell | Tengu: do you have like a tripleo friendy Beast under your table ? | 05:50 |
| Tengu | yep | 05:50 |
| Tengu | quiquell: https://share.tengu.ch/workplace/photo5906792561853443946.jpg | 05:50 |
| Tengu | meet the epyc and its 64G ram plus some hard drives/ssd | 05:51 |
| quiquell | Black Beast... it should wake up all your neighbours | 05:51 |
| Tengu | nope - really silent :). | 05:51 |
| Tengu | the noctua thingy on the CPU is a breeze | 05:52 |
| Tengu | and all the fans in the case have the owl-like shape for silent work. | 05:52 |
| quiquell | Tengu: so, this sasl command cannot being executed because tls_password is missing 'saslpasswd2 -d -a libvirt -u overcloud migration' | 05:52 |
| Tengu | really convenient. | 05:52 |
| Tengu | quiquell: nah | 05:52 |
| Tengu | quiquell: the saslpasswd2 is executed as expected. | 05:52 |
| Tengu | it just doesn't pass the environment TLS_PASSWORD as it's empty | 05:53 |
| quiquell | Tengu: but without TLS_PASSWORD it will do nothing ? | 05:53 |
| Tengu | quiquell: https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/nova/libvirt.pp#L107 | 05:53 |
| Tengu | vs https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/nova/libvirt.pp#L95 | 05:53 |
| *** janki has quit IRC | 05:53 | |
| Tengu | first one is without password, second one is with tls_password thingy | 05:53 |
| Tengu | so basically the commands are different. | 05:53 |
| Tengu | I would not obsess on that warning, but get more details on the Augeas issue right after that. | 05:54 |
| quiquell | Tengu: ack, so red herring | 05:54 |
| *** janki has joined #tripleo | 05:54 | |
| Tengu | if the exec was a failure, puppet would crash at that point, issue an "Error" and show the command output. | 05:54 |
| Tengu | unfortunately, it's augeas failing, and that nasty boy doesn't output anything -.- | 05:54 |
| quiquell | Tengu: what's augeas ? | 05:55 |
| Tengu | quiquell: a wonderful yet horrible thing | 05:55 |
| quiquell | Tengu: And it kind of sarcastic "See debug" :-) | 05:55 |
| Tengu | quiquell: its goal is to allow a seemless edition of any file using "lenses", basically a file describing the file format we want | 05:55 |
| Tengu | it's truely powerful. but at the same time, a real pain in the a** to debug :'( | 05:56 |
| Tengu | I'd rather have the Exec fail rather than augeas, even if I don't know sasl XD | 05:56 |
| Tengu | soo. | 05:57 |
| *** shyam89 has joined #tripleo | 05:58 | |
| Tengu | come here little beast :). I'm launching the reproducer, that's the best thing to do. | 05:58 |
| Tengu | quiquell: although..... I doubt the issue is related to https://github.com/openstack/puppet-nova/commit/0c54e9becb362c24e4e322ab75b885fbb6691e4e#diff-e9f81c8cca336ab747bef432d275854f | 06:01 |
| Tengu | quiquell: reason: 29 days old. Might be more related to some qemu update? | 06:02 |
| Tengu | or something like that | 06:02 |
| Tengu | is there a way to get some versions for it? | 06:02 |
| quiquell | Tengu: sure | 06:02 |
| quiquell | Tengu: puppet-nova-14.0.0-0.20181009210802.aa2893d.el7.noarch | 06:03 |
| quiquell | Tengu: puppet-tripleo-10.0.0-0.20181007013831.d212ee6.el7.noarch | 06:03 |
| Tengu | quiquell: what about qemu and its friends? | 06:03 |
| quiquell | Tengu: qemu-img-ev-2.10.0-21.el7_5.4.1.x86_64 | 06:04 |
| quiquell | Tengu: Did it has friends ? | 06:04 |
| Tengu | there are som deps and libs I think, yeah. anyway, do you know when that one was introduced? | 06:04 |
| quiquell | Tengu: let me compare with a good one | 06:05 |
| Tengu | thanks :) | 06:05 |
| Tengu | I'll ensure the file actually exists in the container - might be something to do with permissions, in the end. | 06:05 |
| Tengu | the "augeas failed ..." means many things: wrong format, permission denied, and probably some other issues I can't think of. | 06:06 |
| quiquell | Tengu: Could be related to this https://bugs.launchpad.net/tripleo/+bug/1796764 ? | 06:06 |
| openstack | Launchpad bug 1796764 in tripleo "undercloud install failing for containers-multinode in the gate "OperationalError: (sqlite3.OperationalError) database is locked "" [Critical,Fix released] | 06:06 |
| Tengu | hmmm nope, I don't think so. mwhahaha talked about it with weshay yesterday I think, root cause seems to be ARA accessing/locking the sqlite3 DB | 06:07 |
| Tengu | and augeas has nothing to do with sqlite3 in this case anyway | 06:07 |
| quiquell | Tengu: has to be really really new | 06:07 |
| quiquell | Tengu: 9 oct 10:41 UTC it was working | 06:08 |
| Tengu | quiquell: is it a transcient error? already rechecked it? | 06:08 |
| *** ksambor has joined #tripleo | 06:08 | |
| quiquell | Tengu: not transient, I see it in other reviews, and the noop change too | 06:08 |
| quiquell | Tengu: is massive, even standalone is failing there | 06:08 |
| Tengu | yeah, one of mine has the same issue. | 06:08 |
| Tengu | quiquell: care to open an LP for tracking? | 06:09 |
| Tengu | and mark it as blocker, urgent, critical, whatever | 06:09 |
| marios|rover | Tengu: quiquell is that undercloud install failing? | 06:09 |
| marios|rover | or something new? | 06:09 |
| Tengu | marios|rover: overcloud | 06:09 |
| quiquell | marios|rover: It's new, even standalone is failing | 06:09 |
| *** sai_p has quit IRC | 06:09 | |
| quiquell | marios|rover: check noop https://review.openstack.org/#/c/560445/ | 06:09 |
| Tengu | marios|rover: 2018-10-10 05:02:09 | "Error: /Stage[main]/Nova::Compute::Libvirt::Qemu/Augeas[qemu-conf-limits]: Could not evaluate: Saving failed, see debug", | 06:09 |
| marios|rover | quiquell: well fantastic then | 06:10 |
| quiquell | Tengu: maybe you want to exercise standalone at your reproducer since it's faster | 06:10 |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 06:10 |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 06:10 |
| quiquell | marios|rover: Yep it's going to be like impossible to merge the OVB fix :-( | 06:10 |
| Tengu | quiquell: well, it's already running, undercloud is getting installed. | 06:10 |
| Tengu | quiquell: do you want me to open the LP? | 06:10 |
| chandankumar | Good Morning Guys, Back from Grand PyCon India 2018 :-) | 06:11 |
| Tengu | chandankumar: hey, welcome back :) | 06:11 |
| chandankumar | Tengu: \o/ | 06:11 |
| Tengu | quiquell: I'm opening the LP :) | 06:11 |
| quiquell | Tengu: ups sorry marios|rover ^ | 06:11 |
| quiquell | Tengu: have to drop for a few | 06:12 |
| marios|rover | thanks Tengu | 06:12 |
| *** quiquell is now known as quiquell|brb | 06:12 | |
| *** Petersingh has joined #tripleo | 06:12 | |
| marios|rover | ERROR configuring nova_libvirt ? | 06:12 |
| *** shyam89 has quit IRC | 06:12 | |
| Tengu | marios|rover: it's a "promotion-blocker" right? | 06:14 |
| Tengu | marios|rover: https://bugs.launchpad.net/tripleo/+bug/1797035 | 06:15 |
| openstack | Launchpad bug 1797035 in tripleo "Gate fails on Augeas for qemu-conf-limits" [Critical,Triaged] | 06:15 |
| marios|rover | Tengu: well that isn't a promotion job itself failing in the check now | 06:16 |
| Tengu | marios|rover: so "just" a gate blocker ? | 06:17 |
| chandankumar | Tengu: I need some help on these two changes https://review.openstack.org/#/c/605980/ and https://review.openstack.org/#/c/605356/ | 06:17 |
| marios|rover | Tengu: yeah master gate is pretty serious and i haven't seen where else it fails like that anyway | 06:17 |
| marios|rover | thanks for bug Tengu | 06:17 |
| chandankumar | Tengu: I am doing something wrong, directory is not getting mounted | 06:17 |
| Tengu | chandankumar: the ones for mistral+podman? | 06:17 |
| chandankumar | Tengu: nope it is related to tempest | 06:17 |
| Tengu | well, tempest, yes | 06:17 |
| Tengu | chandankumar: EmilienM told me you might want help on that :). well, I can have a spare minutes waiting for the reproducer to fail. gimme a minute. | 06:18 |
| *** gkadam has quit IRC | 06:18 | |
| chandankumar | Tengu: sure | 06:18 |
| Tengu | chandankumar: so the modification in here are OK: https://review.openstack.org/#/c/605980/10/docker/services/tempest.yaml it should create the correct paths on the host with the right setype, and then mount two of the directories in the container, at step2 (ONLY step2) | 06:19 |
| chandankumar | Tengu: yup, I think something wrong I am doing here | 06:20 |
| chandankumar | Tengu: https://review.openstack.org/#/c/605356/17 | 06:20 |
| Tengu | yeah, reviewing that one, wait | 06:20 |
| Tengu | chandankumar: where does this script run from? https://review.openstack.org/#/c/605356/20/roles/validate-tempest/templates/configure-tempest.sh.j2 | 06:21 |
| Tengu | marios|rover: don't hesitate to correct tags if needed. I'm not that used to this kind of issue ;). | 06:21 |
| chandankumar | Tengu: https://review.openstack.org/#/c/605356/20/roles/validate-tempest/templates/configure-tempest.sh.j2@74 when tempest format is container, then we create a seperate script and that script is copied with in container and involved while container run | 06:22 |
| Tengu | chandankumar: if it's from the host, the setype would not be correct, although the host_prep_tasks should kick in far earlier than this script, thus you should get the right permissions. | 06:22 |
| chandankumar | Tengu: yes | 06:23 |
| Tengu | chandankumar: do you have any error we can investigate and work? because right now I don't see what might be wrong with that. | 06:23 |
| chandankumar | Tengu: http://logs.openstack.org/56/605356/20/check/tripleo-ci-centos-7-undercloud-containers/786a06d/logs/undercloud/home/zuul/tempest_container.sh.txt.gz | 06:24 |
| chandankumar | Tengu: http://logs.openstack.org/56/605356/20/check/tripleo-ci-centos-7-undercloud-containers/786a06d/logs/undercloud/home/zuul/tempest.log.txt.gz#_2018-10-09_14_03_50 | 06:24 |
| Tengu | ah, yeah. | 06:24 |
| chandankumar | Tengu: with in the container, It is failing to find the /var/lib/tempest directory | 06:24 |
| Tengu | wait... | 06:24 |
| chandankumar | Tengu: It is the parent script http://logs.openstack.org/56/605356/20/check/tripleo-ci-centos-7-undercloud-containers/786a06d/logs/undercloud/home/zuul/tempest-setup.sh | 06:25 |
| *** rdopiera has joined #tripleo | 06:25 | |
| Tengu | ah, great. | 06:25 |
| Tengu | so, line 23. | 06:25 |
| marios|rover | Tengu: updated the title/description fyi | 06:26 |
| *** shyam89 has joined #tripleo | 06:26 | |
| marios|rover | Tengu: (added more from the check job) | 06:26 |
| Tengu | marios|rover: no problem - you can assign it to me (for now) if you want, as I'm trying to get it reproduced on my infra. | 06:26 |
| chandankumar | Tengu: in the run time, tempest needs a empty directoty under container, where tempest related stuff gets created automatically | 06:26 |
| Tengu | chandankumar: well. | 06:27 |
| marios|rover | Tengu: ack but which one ('cedjo7?' | 06:27 |
| Tengu | chandankumar: $TEMPEST_DIR is apparently not set... ? | 06:27 |
| Tengu | marios|rover: cjeanner | 06:27 |
| marios|rover | Tengu: or Cedric Jeanneret deactivated | 06:27 |
| Tengu | chandankumar: unless it's passed as a container var? | 06:27 |
| marios|rover | Tengu: gotcha | 06:27 |
| chandankumar | Tengu: https://review.openstack.org/#/c/605356/20/roles/validate-tempest/templates/configure-tempest.sh.j2@68 | 06:27 |
| chandankumar | Tengu: you mean I need to pass with docker/podman run agrument? | 06:28 |
| Tengu | chandankumar: at least in the generated file here: http://logs.openstack.org/56/605356/20/check/tripleo-ci-centos-7-undercloud-containers/786a06d/logs/undercloud/home/zuul/tempest-setup.sh it's not present | 06:28 |
| Tengu | you can look for OEF string, this will generate the inner script | 06:28 |
| chandankumar | Tengu: yes got it | 06:29 |
| Tengu | and there isn't any mention of the exported var | 06:29 |
| Tengu | so I guess that's the main issue. | 06:29 |
| chandankumar | Tengu: export TEMPEST_DIR='/var/lib/tempest' | 06:29 |
| chandankumar | Tengu: it is getting done in the main script | 06:29 |
| chandankumar | Tengu: Let me pass with docker and see what happens | 06:29 |
| *** shyam89 has quit IRC | 06:31 | |
| *** shyam89 has joined #tripleo | 06:31 | |
| Tengu | chandankumar: chandankumar hm, in order to get it in container you should pass it with -e TEMPEST_DIR='...' | 06:31 |
| Tengu | i.e. container_cli -e TEMPEST_DIR=... run foo bar | 06:32 |
| *** kopecmartin|ruck is now known as kopecmartin|scho | 06:32 | |
| *** mschuppert has joined #tripleo | 06:33 | |
| chandankumar | Tengu: updated, https://review.openstack.org/#/c/605356/21/roles/validate-tempest/templates/run-tempest.sh.j2@102 | 06:35 |
| chandankumar | I hope it will do the job | 06:36 |
| Tengu | lemme check that. | 06:36 |
| Tengu | chandankumar: -e TEMPEST_DIR="${TEMPEST_DIR}" | 06:36 |
| *** janki has quit IRC | 06:38 | |
| chandankumar | Tengu: done, thanks :-) | 06:38 |
| Tengu | np :) | 06:38 |
| *** janki has joined #tripleo | 06:38 | |
| Tengu | marios|rover quiquell|brb running a standalone deploy in // of the reproducer itself. | 06:39 |
| *** aufi_ has joined #tripleo | 06:41 | |
| Tengu | guess the standalone will be faster - I allocat "some" resources to the VM by default. | 06:42 |
| *** mburned_out is now known as mburned | 06:43 | |
| *** apetrich has quit IRC | 06:45 | |
| chandankumar | Tengu: If standalone is going to take less than 2 hours will full tempest api and scenario we can move this job against all upstream project | 06:45 |
| Tengu | chandankumar: can't say for this case - I don't think tempest is deployed with standalone by default. I didn't investigate it very long, I just used it in order to validate my podman+selinux work :) | 06:47 |
| chandankumar | Tengu: once this patch merged, I will do a cleanup of the role | 06:47 |
| Tengu | ok :) | 06:48 |
| *** pcaruana has joined #tripleo | 06:50 | |
| *** cylopez has joined #tripleo | 06:54 | |
| *** quiquell|brb is now known as quiquell | 06:54 | |
| *** cylopez has left #tripleo | 06:54 | |
| quiquell | Tengu: found anything ? | 06:55 |
| Tengu | quiquell: still running | 06:55 |
| quiquell | Tengu: puppet nova version is new | 06:55 |
| Tengu | I'm also taking this opportunity to test the beast :]. 1 reproducer + 1 standalone in //. seems to work. | 06:55 |
| Tengu | quiquell: puppet-nova? hmmm. so the patch for the sasl thingy wasn't packaged before yesterday or something like that? | 06:56 |
| quiquell | Tengu: There is something weird, we didn't have a master promotion but puppet-nova is new | 06:56 |
| Tengu | o_O | 06:56 |
| Tengu | janki: don't obsess on gate, there's a major failure preventing the runs. | 06:57 |
| *** aufi_ has quit IRC | 06:57 | |
| Tengu | and I can't change the topic as I'm no channel operator :( | 06:58 |
| *** rcernin has quit IRC | 06:58 | |
| quiquell | Tengu: The difference is https://github.com/openstack/puppet-nova/commit/aa2893d7e07e0dc37935e602fcdbca99b102d35e | 06:58 |
| quiquell | Tengu: at least in puppet nova, but I want to understand why we had new version there | 06:58 |
| Tengu | yeah so that famous thingy. | 06:58 |
| quiquell | Tengu: Humm we are having current from "puppet-*" | 06:59 |
| quiquell | Tengu: so puppet has to be aligned with the latest of each | 06:59 |
| quiquell | Tengu: going to test a revert on that | 07:00 |
| Tengu | ok | 07:00 |
| quiquell | Tengu: the patch add new changes to qemu-conf-limits | 07:01 |
| quiquell | Tengu: So it can be related | 07:01 |
| *** jfrancoa has joined #tripleo | 07:02 | |
| *** ykarel has joined #tripleo | 07:03 | |
| quiquell | mschuppert: Are you there ? | 07:05 |
| *** agopi has quit IRC | 07:06 | |
| *** ade_lee has quit IRC | 07:06 | |
| *** agopi has joined #tripleo | 07:07 | |
| *** iurygregory has joined #tripleo | 07:07 | |
| *** odyssey4me has quit IRC | 07:07 | |
| *** ajo has quit IRC | 07:08 | |
| *** odyssey4me has joined #tripleo | 07:08 | |
| *** ajo has joined #tripleo | 07:08 | |
| quiquell | Tengu: -logdest syslog | 07:08 |
| quiquell | Tengu: we are running puppet with syslog activated | 07:08 |
| *** mugsie has quit IRC | 07:08 | |
| mschuppert | quiquell: yes | 07:09 |
| *** mgagne has quit IRC | 07:09 | |
| quiquell | mschuppert: We have a massive gate failure, could be related to this patch https://github.com/openstack/puppet-nova/commits/master | 07:09 |
| quiquell | mschuppert: http://logs.openstack.org/45/560445/160/check/tripleo-ci-centos-7-standalone/961edf2/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 07:09 |
| *** mgagne has joined #tripleo | 07:10 | |
| *** jroll has quit IRC | 07:10 | |
| *** Tengu has quit IRC | 07:10 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 07:10 |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797035 | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 07:10 |
| quiquell | mschuppert: One of the qemu-conf-augeas is failing | 07:10 |
| openstack | Launchpad bug 1797035 in tripleo "scenario multinode jobs failling during overcloud deploy - ERROR: 18918 -- Failed running docker-puppet.py for nova_libvirt" [Critical,Triaged] - Assigned to Cédric Jeanneret (cjeanner) | 07:10 |
| *** Tengu has joined #tripleo | 07:10 | |
| Tengu | quiquell: ah, standalone just failed. | 07:10 |
| *** janki has quit IRC | 07:11 | |
| Tengu | quiquell: so yeah, can reproduce it in standalone. much faster :) | 07:11 |
| *** janki has joined #tripleo | 07:11 | |
| quiquell | Tengu: try just to revert https://github.com/openstack/puppet-nova/commit/aa2893d7e07e0dc37935e602fcdbca99b102d35e | 07:11 |
| quiquell | Tengu: to check this out | 07:11 |
| Tengu | quiquell: 2s. Inspecting docker-puppet-nova_libvirt | 07:12 |
| quiquell | Tengu: I am just trying to find which one of the qemu-conf-augeas is failing | 07:12 |
| Tengu | it's the failed container. | 07:12 |
| quiquell | Tengu: ack, can we see witch one ? | 07:12 |
| janki | Tengu, but 2 of my patches got merged in the same gate run so I rechecked | 07:12 |
| *** jroll has joined #tripleo | 07:12 | |
| Tengu | janki: failure's recent ;). anyway. we're trying to shoot it. | 07:13 |
| quiquell | mschuppert: Do you know if we need newer versions of other opnestack projects for the patch to work ? | 07:13 |
| janki | Tengu, ack. SHould I abondon the patches to clear up the queue? | 07:13 |
| Tengu | janki: not yet. we're investi-gating | 07:14 |
| mschuppert | quiquell: yes lets revert that one as it sets a qemu parameter which might require a newer libvirt version. that might result in the error | 07:14 |
| janki | Tengu, good one :P | 07:14 |
| Tengu | ;) | 07:14 |
| quiquell | mschuppert: so maybe it depends on promotion ? | 07:14 |
| Tengu | mschuppert: apparently it's the nbd_tls one | 07:14 |
| Tengu | not present at all in the qemu.conf. | 07:14 |
| * quiquell is writting 'investi-gating' in stone | 07:14 | |
| Tengu | quiquell: ;) | 07:15 |
| mschuppert | Tengu: yes that is the new one. | 07:15 |
| mschuppert | wondering why it passed ci ... | 07:15 |
| quiquell | mschuppert: Humm that's true... | 07:15 |
| Tengu | ah, yeah, right, got mixed up with the -/+ due to the coma. | 07:15 |
| quiquell | mschuppert: let's check that | 07:15 |
| Tengu | mschuppert: btw, lists in puppet should get a "," for their last element | 07:15 |
| Tengu | it's not like json :) | 07:16 |
| mschuppert | Tengu: ack thx | 07:16 |
| Tengu | anyway. quiquell when you have a patch I can put it in use in my env. | 07:16 |
| *** shyam89 has quit IRC | 07:17 | |
| quiquell | mschuppert: uppet-nova has a tripleo-undercloud job at the gates weird it passed | 07:17 |
| *** shyam89 has joined #tripleo | 07:17 | |
| *** amoralej|off is now known as amoralej | 07:17 | |
| quiquell | mschuppert: Maybe it uses newer versions | 07:17 |
| quiquell | :-( | 07:17 |
| Tengu | brb - breakfast. | 07:17 |
| quiquell | marios|rover: going to revert mschuppert change, looks like it is the problem | 07:18 |
| marios|rover | quiquell: ack thanks mate been tracking nice one | 07:18 |
| marios|rover | kopecmartin|scho: ^^ fyi | 07:19 |
| quiquell | marios|rover: Just checking that we were not screwing it with the new promotion jobs and all | 07:19 |
| quiquell | mschuppert: do we have to backport the revert ? | 07:20 |
| *** jpich has joined #tripleo | 07:21 | |
| mschuppert | quiquell: no its only in master | 07:21 |
| quiquell | Tengu, mschuppert, mschuppert: https://review.openstack.org/609289 | 07:22 |
| quiquell | marios|rover: testing patch https://review.openstack.org/#/c/609290/ | 07:25 |
| quiquell | marios|rover: standalone is fast so we will be able to check it out soon | 07:25 |
| marios|rover | ack quiquell | 07:26 |
| quiquell | marios|rover: what else do we have that prevent the OVB fix to be m erged ? | 07:28 |
| quiquell | marios|rover: I want to have a master/rocky promotio to check that it's working with the new stuff | 07:28 |
| marios|rover | quiquell: ovb fix is the ssl one you mean? | 07:30 |
| marios|rover | quiquell: or the ironic one? | 07:30 |
| quiquell | marios|rover: https://review.openstack.org/#/c/608589/ | 07:30 |
| *** panda has quit IRC | 07:30 | |
| quiquell | mschuppert: we have to find why the tripleo job at puppet-nova failed | 07:31 |
| *** salmankhan has joined #tripleo | 07:31 | |
| quiquell | mschuppert: I mean pssed at the review | 07:31 |
| quiquell | mschuppert: what libvirt package your change depends on ? | 07:31 |
| marios|rover | quiquell: yeah ssl one not aware of something else there but it kept hitting the different issues on each run | 07:31 |
| quiquell | marios|rover: the ssl only affect promotions or it also affect gates ? | 07:32 |
| *** panda has joined #tripleo | 07:32 | |
| marios|rover | quiquell: promotions too | 07:32 |
| Tengu | quiquell: ah, yeah, we can test it even with containers as they mount the puppet thingy into. | 07:32 |
| marios|rover | quiquell: in fact it was the legacy ovb fs1/35 jobs that were failing | 07:33 |
| quiquell | marios|rover: new ovb ones are failing too there | 07:33 |
| Tengu | quiquell: re-running the standalone with your patch. | 07:34 |
| Tengu | chandankumar: is the correction OK for your tempest work? | 07:34 |
| *** mgagne has quit IRC | 07:34 | |
| mschuppert | quiquell: libvirt-4.5 | 07:35 |
| quiquell | mschuppert: argg undercloud-container works that's what we are running at puppet-nva | 07:35 |
| quiquell | mschuppert: is all the other that fail :-/( | 07:35 |
| mschuppert | quiquell: :( ok | 07:35 |
| quiquell | mschuppert: Make sense to add standalone to puppet-nova ? | 07:35 |
| mschuppert | quiquell: yes I'd say so | 07:36 |
| quiquell | mschuppert: will do | 07:36 |
| *** shyam89 has quit IRC | 07:36 | |
| mschuppert | quiquell: thx. sorry for the mess | 07:36 |
| *** mgagne has joined #tripleo | 07:36 | |
| *** salmankhan has quit IRC | 07:37 | |
| quiquell | mschuppert: no problem, now that we have standalone we have to start gating stuff with it | 07:37 |
| quiquell | mschuppert: it does not consume much resources | 07:38 |
| mschuppert | quiquell: cool, makes sense | 07:38 |
| quiquell | mschuppert: Maybe we can replace the tripleo-puppet-undercloud | 07:38 |
| Tengu | quiquell: lemme check that with the standalone - that's the best way. currently running, it's "installing tripleo client", then it will build the puppet-nova package, and banzai. | 07:41 |
| chandankumar | Tengu: yes | 07:41 |
| Tengu | chandankumar: \o/ | 07:41 |
| *** tosky has joined #tripleo | 07:42 | |
| *** Petersingh is now known as Petersingh|lunch | 07:46 | |
| *** shyam89 has joined #tripleo | 07:48 | |
| quiquell | mschuppert, Tengu, marios|rover: https://review.openstack.org/#/c/609301/ | 07:50 |
| quiquell | To run standalone at puppet-nova, Can we add it to the rest of puppet- projects ? | 07:51 |
| *** jchhatbar has joined #tripleo | 07:51 | |
| quiquell | jaosorior: Are you there ? | 07:52 |
| *** janki has quit IRC | 07:52 | |
| mschuppert | quiquell: I'd vote for yes | 07:52 |
| Tengu | quiquell: I think it should be done, yeah. at least project used in standalone. Not sure we use all of them. | 07:52 |
| Tengu | but in that precise case, puppet-nova is used, so +1 (can't +2 :'( ) | 07:53 |
| *** jchhatbar has quit IRC | 07:53 | |
| *** janki has joined #tripleo | 07:53 | |
| Tengu | quiquell: standalone is currently deploying with your revert - will give you a feedback once it's either failed or succeed | 07:53 |
| quiquell | mschuppert, Tengu: going to add to all puppet- projects that run tripleo-undercloud | 07:54 |
| *** gkadam has joined #tripleo | 07:55 | |
| *** shyam89 has quit IRC | 07:55 | |
| *** apetrich has joined #tripleo | 07:56 | |
| quiquell | Tengu: do you know if we are planning on removing puppet from standalone ? | 07:57 |
| Tengu | quiquell: no idea - guess mwhahaha might know more about that. | 07:57 |
| Tengu | or dprince, when he connects. | 07:57 |
| quiquell | Tengu: do you know what puppet- projects are used by standalone ? | 07:59 |
| *** janki has quit IRC | 08:01 | |
| *** janki has joined #tripleo | 08:01 | |
| Tengu | quiquell: not really. as said, I didn't go far in investigating what it actually does. There are at least keystone, nova, swift, redis, mysql/galera, neutron, horizon | 08:04 |
| quiquell | Tengu: ack | 08:04 |
| quiquell | Tengu: I suppose ironic is not | 08:05 |
| Tengu | quiquell: hmm yeah, no ironic ( dtantsur|afk ?) | 08:05 |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 08:10 |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797035 | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 08:10 |
| openstack | Launchpad bug 1797035 in tripleo "scenario multinode jobs failling during overcloud deploy - ERROR: 18918 -- Failed running docker-puppet.py for nova_libvirt" [Critical,In progress] - Assigned to Cédric Jeanneret (cjeanner) | 08:10 |
| *** janki has quit IRC | 08:10 | |
| *** ramishra has quit IRC | 08:12 | |
| Tengu | quiquell: at least the patch allows to go to step 2 in the standalone deploy - I therefore think it's OK. | 08:12 |
| Tengu | quiquell: ah, wrong - apparently the file isn't modified yet. damn. | 08:13 |
| *** ramishra has joined #tripleo | 08:13 | |
| Tengu | let's see what step should fail. I didn't check that with the previous run :/. bad. | 08:13 |
| quiquell | Tengu: do we have puppet for galera or redis ? | 08:17 |
| quiquell | Tengu: Don't find them | 08:17 |
| Tengu | wait. | 08:17 |
| Tengu | puppet-mysql-6.0.1-0.20180802105733.204cfd4.el7.noarch | 08:18 |
| quiquell | Tengu: but that's not a openstack project | 08:19 |
| Tengu | quiquell: http://github.com/puppetlabs/puppetlabs-mysql we're using upstream | 08:19 |
| quiquell | Tengu: not sure we can do standalone ther e | 08:19 |
| Tengu | although it's in DLRN repo | 08:19 |
| quiquell | Tengu: same with puppet-redis | 08:19 |
| *** shardy has joined #tripleo | 08:19 | |
| Tengu | yeah, it makes sense for sur modules. | 08:19 |
| Tengu | so I'd say "put standalone zuul for openstack modules" | 08:20 |
| *** bogdando has joined #tripleo | 08:20 | |
| Tengu | althoug we might want to ensure they are actually in use on standalone. for that we might need some more help from DF team. | 08:20 |
| Tengu | lemme check something. | 08:20 |
| Tengu | quiquell: https://github.com/openstack/tripleo-heat-templates/blob/master/environments/standalone.yaml | 08:21 |
| Tengu | so I was pretty close - I just missed "cinder" and "glance" :) | 08:22 |
| quiquell | Tengu: https://review.openstack.org/#/q/topic:standalone-puppet-gates+(status:open+OR+status:merged) | 08:22 |
| Tengu | quiquell: cool - might want to add glance and cinder according to the tmpl I just linked. | 08:22 |
| *** sshnaidm|afk is now known as sshnaidm | 08:22 | |
| Tengu | quiquell: at least the revert DOES work, I'm at step 5 now. | 08:22 |
| Tengu | so now we need some cores for https://review.openstack.org/609289 ( jaosorior shardy please :) ) | 08:23 |
| *** skramaja has joined #tripleo | 08:24 | |
| quiquell | Tengu: check if I missing any https://review.openstack.org/#/q/topic:standalone-puppet-gates ? | 08:25 |
| quiquell | Tengu: I think it's ok now | 08:25 |
| *** phuongnh has joined #tripleo | 08:25 | |
| Tengu | quiquell: at least we get the beefy part. | 08:25 |
| Tengu | quiquell: a second check from one of the "standalone guru" would still be good ;). | 08:26 |
| quiquell | Tengu: we don't se heat at standalone ? | 08:28 |
| quiquell | Tengu: who can I ask to the reviews ? | 08:28 |
| quiquell | s/ask/add/ | 08:29 |
| Tengu | quiquell: I'd say dprince and mwhahaha mainly. maybe bogdando | 08:29 |
| chandankumar | Tengu: http://logs.openstack.org/56/605356/22/check/tripleo-ci-centos-7-undercloud-containers/cbaf8d5/logs/undercloud/home/zuul/tempest.log.txt.gz#_2018-10-10_08_02_36 | 08:30 |
| chandankumar | Tengu: unable to pull TEMPEST_DIR=${TEMPEST_DIR}: error getting default registries to try: invalid reference format | 08:30 |
| bogdando | woa, that https://review.openstack.org/#/q/topic:standalone-puppet-gates+(status:open+OR+status:merged) is really nice to see | 08:30 |
| bogdando | but where is the job logs?.. | 08:30 |
| quiquell | bogdando: we were hit buy merged stuff because we where not covering standalone, so it's a reallity now | 08:30 |
| Tengu | chandankumar: well, err, you don't know hat to pass env var to docker/podman, do you? | 08:30 |
| quiquell | bogdando: Can you help with to land thosw ? | 08:31 |
| chandankumar | Tengu: one in | 08:31 |
| bogdando | quiquell: yes, but would be nice to have build logs | 08:31 |
| bogdando | some DNM patches perhaps | 08:31 |
| chandankumar | Tengu: sorry I missed -e | 08:31 |
| quiquell | bogdando: Why DNM patches, the reviews are already triggering standalone | 08:31 |
| bogdando | hmmm | 08:32 |
| Tengu | chandankumar: and you want to puth that new env with the others. | 08:32 |
| Tengu | chandankumar: order does matter with CLI params ;). | 08:32 |
| bogdando | quiquell: not here https://review.openstack.org/#/c/609308/ ? | 08:32 |
| Tengu | so just put your -e TEMPEST_DIR="${TEMPEST_DIR}" near the CURL_CA_BUNDLE for example. | 08:32 |
| bogdando | quiquell: I think it should replace undercloud | 08:32 |
| Tengu | chandankumar: so that we get a grouped thingy, more readable | 08:33 |
| quiquell | bogdando: It's running there | 08:33 |
| quiquell | bogdando: Yep about undercloud didn't know if it worth it now | 08:33 |
| *** derekh has joined #tripleo | 08:33 | |
| bogdando | IMO it does | 08:33 |
| quiquell | bogdando: Can you check that I don't miss any puppet-foobar that standalone is using ? | 08:33 |
| bogdando | btw, I only have +1 there | 08:33 |
| Tengu | quiquell: Deployment successfull! | 08:33 |
| Tengu | quiquell: that's with the revert ( mschuppert as well ) | 08:34 |
| quiquell | Tengu: yei !!! marios|rover ^ | 08:34 |
| quiquell | bogdando, Tengu: So what reviewers do we add: mwhahaha, dprince... someone else ? | 08:34 |
| Tengu | chandankumar: double-quotes for variable | 08:35 |
| Tengu | chandankumar: "${TEMPEST_DIR}" not '${TEMPEST_DIR}' | 08:35 |
| quiquell | bogdando: Is there any puppet- that is run at undercloud and not standalone ? | 08:35 |
| bogdando | good question | 08:35 |
| marios|rover | quiquell: ack great stuff | 08:36 |
| *** aufi_ has joined #tripleo | 08:36 | |
| bogdando | afaik, standalone includes all that undercloud and overcloud has | 08:36 |
| bogdando | mwhahaha: am I right? ^^ | 08:36 |
| Tengu | bogdando: not really in fact. at least not according to the standalone.yaml | 08:36 |
| quiquell | marios|rover: I want to have standalone staff at all possible gates before my next ruck/rovering | 08:36 |
| bogdando | Tengu: ;( | 08:36 |
| Tengu | quiquell: how surprising :D | 08:36 |
| bogdando | I thought Alex included the world there | 08:37 |
| Tengu | bogdando: as you're here, care to vote on that one? https://review.openstack.org/#/c/609289/ it will unlock gate. | 08:37 |
| Tengu | bogdando: https://github.com/openstack/tripleo-heat-templates/blob/master/environments/standalone.yaml#L15-L22 | 08:37 |
| bogdando | I failed to find any correlation to the failure root cause | 08:37 |
| bogdando | thus didn't vote | 08:37 |
| Tengu | bogdando: apparently the libvirt version we have doesn't support the new param in qemu.conf. | 08:37 |
| quiquell | Tengu, bogdandoÃo: We don't run standalone at puppet-tpleo ? ... | 08:37 |
| Tengu | brb, will do the disk install in the beast. | 08:39 |
| *** fhubik has joined #tripleo | 08:39 | |
| *** fhubik has quit IRC | 08:39 | |
| bogdando | quiquell: one more concern for the topic is metadata.json | 08:39 |
| bogdando | maybe we should also test against the dependency changes | 08:39 |
| jaosorior | quiquell, ratailor: Now I am | 08:40 |
| quiquell | jaosorior: Gate consistent blocked, fixed here https://review.openstack.org/#/c/609289/ | 08:41 |
| ratailor | jaosorior, I had a query regarding backport, which is resolved now. Thanks :) | 08:41 |
| *** aufi_ has quit IRC | 08:41 | |
| quiquell | jaosorior: We are planning on running standalone at puppet-projects https://review.openstack.org/#/q/topic:standalone-puppet-gates | 08:41 |
| quiquell | jaosorior: standalone was not running in the merged review | 08:41 |
| jaosorior | quiquell: bummer, I don't have +2 there. | 08:42 |
| jaosorior | did you poke the folks in puppet-openstack? | 08:42 |
| bogdando | quiquell: so we'll need one more for Heat and Mistral | 08:42 |
| quiquell | jaosorior: not yet, adding world to the reviews, who can I add | 08:42 |
| bogdando | puppet-* | 08:42 |
| bogdando | and ironic | 08:43 |
| quiquell | bogdando: ironic ? | 08:43 |
| *** shyam89 has joined #tripleo | 08:43 | |
| quiquell | bogdando: standalone is using ironnic ? | 08:43 |
| bogdando | let's add it there :D | 08:43 |
| bogdando | we can modify in quickstart | 08:43 |
| bogdando | not in tht | 08:43 |
| Tengu | quiquell: no use of ironic in standalone | 08:43 |
| bogdando | overriding roles as we want it for CI | 08:43 |
| bogdando | you can deploy anything in standalone | 08:43 |
| quiquell | Tengu: bogdando want to add it | 08:43 |
| bogdando | and horizon perhaps, or it worth not adding it to puppet-horizon | 08:44 |
| quiquell | bogdando: Ahh ok, so maybe we can modify later the jobs at differnt modules to exercise them, that's it ? | 08:44 |
| bogdando | quiquell: I believe we can | 08:44 |
| bogdando | oooq can override things being deployed easily | 08:44 |
| *** hjensas has quit IRC | 08:44 | |
| quiquell | #join #openstack-puppet | 08:46 |
| quiquell | ups | 08:46 |
| quiquell | jeje | 08:46 |
| quiquell | Not much people there | 08:46 |
| quiquell | bandini: Are you a openstack-puppet master ? | 08:46 |
| bogdando | quiquell: I think a topic for openstack-dev may be a good idea | 08:46 |
| bogdando | to follow up one that weshay created | 08:46 |
| bogdando | with CI standalone roadmap | 08:47 |
| quiquell | bogdando: don't know what you mean | 08:47 |
| bogdando | and you could ask for the replace undercloud with composable standalone jobs | 08:47 |
| chandankumar | standalone deployment is failing, it is a known issue | 08:47 |
| quiquell | bogdando: I just want to have easy ruck rovering next time :-P | 08:47 |
| quiquell | chandankumar: yep, we have a fix for it | 08:47 |
| quiquell | chandankumar: https://review.openstack.org/#/c/609289/ | 08:47 |
| bogdando | quiquell: this http://lists.openstack.org/pipermail/openstack-dev/2018-October/135396.html | 08:48 |
| chandankumar | quiquell: thanks :-) | 08:49 |
| bogdando | so just a follow up for the standalone topic | 08:49 |
| quiquell | bogdando: ack will talk with wes later on | 08:49 |
| quiquell | bogdando: we are also prepareing the standalone over fedora28 thingy | 08:49 |
| bogdando | I mean you could go straight and push an update with those questions for customizable standalone jobs in puppet-foo | 08:50 |
| bogdando | and replacing the UC jobs with those | 08:50 |
| mschuppert | quiquell: cool | 08:51 |
| bogdando | it's also makes sense to not deploy more than is really needed to check the foo component | 08:51 |
| * mschuppert was afk for some time | 08:51 | |
| bogdando | so we do not deploy world for every puppet module | 08:51 |
| bogdando | but only, say keystone for puppet-keystone | 08:51 |
| bogdando | and limiting tempest to that | 08:51 |
| bogdando | and so on | 08:51 |
| quiquell | bogdando: But we have interelations too | 08:51 |
| bogdando | weshay: ^^ | 08:51 |
| quiquell | bogdando: We wnat to test that at puppet-foo | 08:52 |
| bogdando | sure, just need to pick wise | 08:52 |
| chandankumar | bogdando: limiting tempest tests means we want to run test for a particular component only? | 08:52 |
| bogdando | yes | 08:52 |
| bogdando | or a few | 08:52 |
| quiquell | bogdando: I mean we where already running undercloud, replacing by standalone is a good covering | 08:52 |
| bogdando | if we want to test some integrations | 08:52 |
| *** ykarel_ has joined #tripleo | 08:52 | |
| quiquell | bogdando: First let's merge the blocker | 08:52 |
| bogdando | quiquell: ofc, but I cannot, not a core there | 08:53 |
| chandankumar | bogdando: then can be doable just like i have done for https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset027.yml#L88 | 08:53 |
| chandankumar | quiquell: ^^ | 08:53 |
| bogdando | chandankumar: yes, exactly | 08:53 |
| bogdando | so for puppet-mistral we could deploy a standalone job with only DB/MQ/keystone and mistral | 08:53 |
| chandankumar | i think we can also customize the job and reuse the same feature set | 08:53 |
| bogdando | and test only mistral with tempest | 08:53 |
| bogdando | that's the idea | 08:54 |
| bogdando | weshay: quiquell: ^^ | 08:54 |
| quiquell | jaosorior: Wher eis the list of a projects user with superpowers ? | 08:54 |
| quiquell | bogdando: So we need special fs for each ? | 08:54 |
| bogdando | quiquell: seems so | 08:55 |
| quiquell | bogdando: Humm... we have introduce a featoruset override feature with the new workflow | 08:55 |
| chandankumar | quiquell: I think we can customize using {% if lookup('env', 'ZUUL_PROJECT') == "openstack/mistral" -%} | 08:55 |
| bogdando | or that | 08:55 |
| *** ykarel has quit IRC | 08:55 | |
| quiquell | bogdando: so we can use zuul job 'vars:' block, but I think you cannot use it with template | 08:55 |
| bogdando | overriding a single featureset with simple extentions may be a good idea | 08:55 |
| bandini | quiquell: not really. what's the prob? | 08:55 |
| quiquell | bandini: we have a fix at puppet-nova that unblock gates, don't know who to ping | 08:56 |
| bogdando | git blame? :) | 08:56 |
| *** Petersingh|lunch is now known as Petersingh | 08:56 | |
| quiquell | bogdando: I always get the same anser :-) | 08:56 |
| bogdando | heh | 08:56 |
| quiquell | bogdando: who is 'zuul' did it has super powers ? | 08:57 |
| quiquell | sshnaidm: Do you know who can help us merge https://review.openstack.org/#/c/609289/ ? | 08:58 |
| bogdando | quiquell: I think it's sub-zero, he can freeze your jobs in queues to death | 08:58 |
| quiquell | bogdando: Respect | 08:59 |
| sshnaidm | quiquell, I can merge it, np | 09:00 |
| quiquell | sshnaidm: Really ! cool | 09:00 |
| sshnaidm | quiquell, oh, no, sorry | 09:00 |
| sshnaidm | quiquell, puppet is not my favorite puppet.. | 09:00 |
| quiquell | sshnaidm: btw I have put in place this https://review.openstack.org/#/q/topic:standalone-puppet-gates | 09:00 |
| * quiquell does NOT write this joke in stone | 09:01 | |
| sshnaidm | need to wait for EmilienM and mwhahaha | 09:01 |
| quiquell | sshnaidm: ack | 09:01 |
| sshnaidm | they have powers in puppet afaik | 09:01 |
| quiquell | sshnaidm: no one else, where is the file with that info ? | 09:01 |
| sshnaidm | quiquell, https://review.openstack.org/#/admin/groups/134,members | 09:02 |
| quiquell | sshnaidm: I think we have to help to get master/rocky promotions this sprint to test the new RDO stuff | 09:02 |
| sshnaidm | actually chem` can help ;) | 09:02 |
| quiquell | chem`: you there ? | 09:03 |
| quiquell | iurygregory: too | 09:03 |
| quiquell | mnaser: ? | 09:03 |
| *** ykarel_ is now known as ykarel|lunch | 09:03 | |
| iurygregory | me? | 09:03 |
| quiquell | iurygregory: we need to merge this https://review.openstack.org/#/c/609289/ to unblock gates | 09:04 |
| quiquell | iurygregory: can you help there ? | 09:04 |
| iurygregory | quiquell, sure o/ | 09:04 |
| *** akrivoka has joined #tripleo | 09:04 | |
| mnaser | hi quiquell | 09:05 |
| iurygregory | quiquell, can i wait for zull result? to +2? | 09:05 |
| quiquell | iurygregory: also we are adding standalone to openstack-nova | 09:05 |
| mnaser | Let me have a look | 09:05 |
| quiquell | iurygregory: sure | 09:05 |
| quiquell | mnaser: you can help too | 09:05 |
| bandini | quiquell: I'd go in #openstack-puppet and ping folks there, I don't have +2 there | 09:05 |
| iurygregory | its #puppet-openstack | 09:06 |
| iurygregory | the channel | 09:06 |
| quiquell | bandini: They are helping us now | 09:06 |
| quiquell | iurygregory: I have join both :-) | 09:06 |
| quiquell | Tengu: standalone has deploy already in the test review, we are all good | 09:07 |
| quiquell | Tengu: https://zuul.openstack.org/stream/82dd657bf09b4c62960b4c189323e8f0?logfile=console.log | 09:07 |
| quiquell | Tengu: thanks mate | 09:07 |
| quiquell | iurygregory, mnaser: We are also activating tripleo standalone jobs at puppet https://review.openstack.org/#/q/topic:standalone-puppet-gates | 09:08 |
| mnaser | quiquell: be good to ping tobiash who’s the current PTL too | 09:08 |
| iurygregory | yeah | 09:09 |
| Tengu | quiquell: didn't do much ;) | 09:09 |
| Tengu | just pointed to the "real" issue :). | 09:10 |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 09:10 |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797035 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 09:10 |
| openstack | Launchpad bug 1797035 in tripleo "scenario multinode jobs failling during overcloud deploy - ERROR: 18918 -- Failed running docker-puppet.py for nova_libvirt" [Critical,In progress] - Assigned to Cédric Jeanneret (cjeanner) | 09:10 |
| *** kopecmartin|scho is now known as kopecmartin|ruck | 09:10 | |
| Tengu | btw we might also drop the warning with the env I think. | 09:10 |
| Tengu | it's a pretty easy thing to do. | 09:10 |
| Tengu | will have a look later today. | 09:10 |
| EmilienM | sshnaidm: can you tldr me please, what do you need? In my phone now | 09:11 |
| sshnaidm | EmilienM, need to +w https://review.openstack.org/#/c/609289/ , quiquell can provide details | 09:13 |
| EmilienM | sshnaidm: doing it. | 09:13 |
| quiquell | EmilienM: gate blocker | 09:13 |
| quiquell | EmilienM: adding standalone at puppet- gates https://review.openstack.org/#/q/topic:standalone-puppet-gates | 09:13 |
| quiquell | EmilienM: standalone was failing but it was not at puppet-nova gate | 09:13 |
| EmilienM | Done | 09:14 |
| EmilienM | Anything else? | 09:14 |
| quiquell | EmilienM: nope, thanks | 09:14 |
| EmilienM | Good ttyl | 09:14 |
| iurygregory | i was waitting for zull Emilien always fast XD | 09:15 |
| *** jpich has quit IRC | 09:16 | |
| *** jpich has joined #tripleo | 09:17 | |
| Tengu | :) | 09:26 |
| Tengu | iurygregory: well, for the gate unlocker, we actually did test it on the side ;). | 09:26 |
| iurygregory | Tengu, nice o/ | 09:26 |
| Tengu | having a monster under the desk helps a lot in this kind of situation. | 09:27 |
| *** salmankhan has joined #tripleo | 09:32 | |
| chandankumar | arxcruz: Hello | 09:33 |
| *** ykarel|lunch is now known as ykarel | 09:33 | |
| chandankumar | arxcruz: please update this spec file https://review.rdoproject.org/r/16216 | 09:34 |
| *** jpich has quit IRC | 09:36 | |
| *** jpich has joined #tripleo | 09:36 | |
| quiquell | marios|rover: They ask me at openstack-infra for PTL confirmation to priorize the blocker :-) Is it worth it ? | 09:48 |
| quiquell | jaosorior: ^ | 09:48 |
| marios|rover | quiquell: well it is blocking all the things right now, inclduing the fixes to the open bugs | 09:48 |
| marios|rover | quiquell: but maybe given the recent discussion about us using resources we can't push too much on these things | 09:49 |
| quiquell | marios|rover: That was kind of my fault :-( | 09:49 |
| quiquell | marios|rover: We needed that for the migration | 09:49 |
| quiquell | jaosorior: Maybe you can help us with that | 09:50 |
| quiquell | marios|rover: Ahh the fix is at other empty gate :-) we have being ucky for ones :-) | 09:55 |
| *** ykarel_ has joined #tripleo | 09:58 | |
| arxcruz | chandankumar: hey, you just did... | 09:59 |
| arxcruz | chandankumar: i'm doing some medic exams, i'll not be 100% available today :/ | 09:59 |
| *** ykarel has quit IRC | 10:00 | |
| *** ykarel__ has joined #tripleo | 10:02 | |
| *** aufi_ has joined #tripleo | 10:02 | |
| *** ykarel_ has quit IRC | 10:05 | |
| *** ykarel_ has joined #tripleo | 10:06 | |
| *** ykarel__ has quit IRC | 10:09 | |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 10:10 |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797035 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 10:10 |
| openstack | Launchpad bug 1797035 in tripleo "scenario multinode jobs failling during overcloud deploy - ERROR: 18918 -- Failed running docker-puppet.py for nova_libvirt" [Critical,In progress] - Assigned to Cédric Jeanneret (cjeanner) | 10:10 |
| *** shyam89 has quit IRC | 10:11 | |
| *** apetrich has quit IRC | 10:11 | |
| *** shyam89 has joined #tripleo | 10:12 | |
| chandankumar | arxcruz: no problem, let me take care of that | 10:13 |
| bogdando | beagles: hi. Around? I'm testing root wrap containers in podman... Now I have a little issue to solve http://pastebin.test.redhat.com/655640 | 10:13 |
| bogdando | not sure how come a priviliged container can't access it | 10:14 |
| *** ykarel__ has joined #tripleo | 10:14 | |
| *** ykarel_ has quit IRC | 10:17 | |
| *** apetrich has joined #tripleo | 10:18 | |
| *** ykarel_ has joined #tripleo | 10:18 | |
| *** akrivoka_ has joined #tripleo | 10:20 | |
| *** ykarel__ has quit IRC | 10:21 | |
| *** akrivoka has quit IRC | 10:22 | |
| *** ykarel__ has joined #tripleo | 10:23 | |
| jaosorior | quiquell: sorry, went for lunch. back now | 10:24 |
| quiquell | jaosorior: All good for the review | 10:24 |
| *** ykarel_ has quit IRC | 10:25 | |
| chandankumar | sshnaidm: bogdando please have a look at this one https://review.openstack.org/#/c/602347/ | 10:27 |
| *** ykarel__ has quit IRC | 10:29 | |
| *** ykarel has joined #tripleo | 10:31 | |
| *** apetrich has quit IRC | 10:33 | |
| *** shyam89 has quit IRC | 10:34 | |
| *** ykarel_ has joined #tripleo | 10:35 | |
| *** ykarel__ has joined #tripleo | 10:37 | |
| *** ykarel has quit IRC | 10:37 | |
| *** hjensas has joined #tripleo | 10:38 | |
| *** aufi_ has quit IRC | 10:39 | |
| *** ykarel_ has quit IRC | 10:40 | |
| *** jaganathan has quit IRC | 10:45 | |
| *** kopecmartin|ruck is now known as kopecmartin|scho | 10:47 | |
| sshnaidm | chandankumar, commented | 10:49 |
| *** sri_ has joined #tripleo | 10:51 | |
| *** yprokule has joined #tripleo | 10:54 | |
| *** radez has quit IRC | 10:56 | |
| *** dalvarez has quit IRC | 10:56 | |
| *** Petersingh is now known as Petersingh|afk | 10:58 | |
| *** jpena|off has quit IRC | 10:58 | |
| *** amoralej has quit IRC | 11:00 | |
| quiquell | mschuppert: standalone failing https://review.openstack.org/#/c/609305/ :-) | 11:02 |
| quiquell | bogdando: ^ | 11:02 |
| quiquell | So we really cover it | 11:02 |
| quiquell | It's failing at all the puppet projects | 11:03 |
| Tengu | quiquell: your revert is about to pass the gate :). less than 30 minutes apparently. | 11:04 |
| quiquell | Tengu: puppet-nova is small compare with tripleo stuff | 11:04 |
| *** sshnaidm is now known as sshnaidm|afk | 11:04 | |
| Tengu | ^^ | 11:04 |
| quiquell | Tengu: maybe we need more than one gate quebe for tripleo projects :-/ | 11:05 |
| EmilienM | iurygregory: hey welcome here | 11:05 |
| iurygregory | tks EmilienM o/ | 11:05 |
| *** morazi has joined #tripleo | 11:06 | |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797035 | 11:10 |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 11:10 |
| openstack | Launchpad bug 1797035 in tripleo "scenario multinode jobs failling during overcloud deploy - ERROR: 18918 -- Failed running docker-puppet.py for nova_libvirt" [Critical,In progress] - Assigned to Cédric Jeanneret (cjeanner) | 11:10 |
| *** udesale has quit IRC | 11:11 | |
| mschuppert | quiquell: right now thats ok, we have not merged the revert, right? | 11:14 |
| quiquell | mschuppert: soon | 11:15 |
| mschuppert | quiquell: cool. right time for lunch then :) | 11:15 |
| *** dtantsur|afk is now known as dtantsur | 11:16 | |
| dtantsur | Tengu: hey, what was the question? | 11:17 |
| *** phuongnh has quit IRC | 11:19 | |
| Tengu | dtantsur: hey :). about ironic being used in "standalone" deploy. | 11:21 |
| dtantsur | so, what's the question? I guess it depends on which templates you include | 11:23 |
| *** sshnaidm|afk is now known as sshnaidm | 11:24 | |
| Tengu | dtantsur: we were wondering if ironic, by default, is included in the standalone - imho nope because no use of it | 11:24 |
| dtantsur | Tengu: I think it should not be | 11:24 |
| Tengu | good :). | 11:24 |
| *** morazi has quit IRC | 11:32 | |
| Tengu | quiquell: puppet-nova merged. | 11:32 |
| *** shyam89 has joined #tripleo | 11:32 | |
| quiquell | marios|rover, mschuppert: ^ \o/ | 11:32 |
| *** amoralej` has joined #tripleo | 11:32 | |
| Tengu | quiquell: so I think we can close the LP? | 11:33 |
| *** ratailor has quit IRC | 11:33 | |
| quiquell | Tengu: yep | 11:33 |
| quiquell | Done | 11:33 |
| Tengu | ah, ok, was about to do it | 11:33 |
| *** abishop has quit IRC | 11:34 | |
| quiquell | Tengu: testing also here https://review.openstack.org/#/c/609301 | 11:34 |
| quiquell | Tengu: directly in the puppet-nova to see if it works | 11:34 |
| Tengu | \o/ | 11:34 |
| mschuppert | quiquell: perfect \o/ | 11:35 |
| *** Petersingh|afk is now known as Petersingh | 11:37 | |
| bogdando | quiquell: nice! We should really think of composable standalone, as it gives not much value to block puppet-keystone cuz it fails in tripleo cuz of "Failed running docker-puppet.py for nova_libvirt" | 11:37 |
| bogdando | integration should only be covered in tripleo, which uses all of those modules | 11:37 |
| bogdando | imo | 11:37 |
| *** dhill_ has joined #tripleo | 11:38 | |
| quiquell | bogdando: Not sure about it... if keystone is breaking tripleo it would be nice to discover it a puppet-keystone | 11:39 |
| quiquell | bogdando: I see the issue is others can break puppet- reviews | 11:39 |
| bogdando | yes | 11:40 |
| quiquell | bogdando: You have to know that you are breaking one of the "installers" | 11:40 |
| bogdando | as I said, puppet-nova shall not block puppet-keystone | 11:40 |
| *** jpich has quit IRC | 11:40 | |
| bogdando | right, just not sure each puppet module should be running the same integration case | 11:41 |
| *** jpich has joined #tripleo | 11:41 | |
| bogdando | and put red herrings for non relevant modules | 11:41 |
| quiquell | bogdando: I don't know about it | 11:41 |
| bogdando | quiquell: about what? | 11:41 |
| quiquell | bogdando: Abouth what composition is needed at each of them | 11:41 |
| bogdando | I mean, some day that job may be voting, like devstack | 11:41 |
| bogdando | or tempest | 11:42 |
| bogdando | and it shall not fail the keystone puppets cuz of nova puppets blockers | 11:42 |
| quiquell | bogdando: Agree | 11:44 |
| quiquell | bogdando: But if you narrow down too much you end up not really testing tripleo | 11:45 |
| *** rh-jelabarre has joined #tripleo | 11:45 | |
| *** ansmith has quit IRC | 11:47 | |
| bogdando | quiquell: my point is that integration testing of all puppet modules only makes sense for tripleo, and not a particular puppet module | 11:48 |
| *** boazel has joined #tripleo | 11:48 | |
| bogdando | and if a puppet module foo breaks that integration, it would as well break the puppet-foo module deploying that foo in minimal configuration | 11:49 |
| bogdando | makes sense? | 11:49 |
| bogdando | we need a mail thread :) | 11:49 |
| bogdando | please, want to start it? | 11:49 |
| bogdando | as an initiator of the topic ;] | 11:49 |
| *** trown|outtypewww is now known as trown | 11:49 | |
| quiquell | bogdando: So if we know that there is a tripleo interaction like puppet-foo -> puppet-bar the test at puppet-foo has to cover that | 11:50 |
| quiquell | bogdando: But discover this interactions is near impossible | 11:50 |
| bogdando | well, indeed | 11:50 |
| bogdando | not sure... | 11:50 |
| quiquell | bogdando: I am not sure too | 11:50 |
| bogdando | at least we can try to do for the most simple cases | 11:51 |
| quiquell | bogdando: I miss a lot of background | 11:51 |
| bogdando | when it is easy to discover | 11:51 |
| quiquell | bogdando: sure low hanging fruit | 11:51 |
| quiquell | bogdando: for puppet-nova is good like it is ? | 11:52 |
| *** raildo has joined #tripleo | 11:52 | |
| bogdando | I think it only needs keystone, and all ::Nova in tripleo | 11:52 |
| bogdando | well and the common base like ntp/kernel/db/mq all that is needed for any deployment | 11:53 |
| bogdando | I mean those Tripleo::ServiceFoo | 11:53 |
| quiquell | bogdando: I see it's kind of complicated and you have to maintain it too | 11:53 |
| bogdando | http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/environments/standalone.yaml | 11:53 |
| bogdando | I can help with that yes | 11:53 |
| bogdando | let's just first get a blessing for the approach | 11:54 |
| bogdando | so we'll need a mail thread | 11:54 |
| quiquell | bogdando: Maybe we can start with puppet-nova | 11:54 |
| quiquell | bogdando: yep | 11:54 |
| *** leanderthal has joined #tripleo | 11:54 | |
| bogdando | quiquell: http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/environments/standalone/standalone-overcloud.yaml#n12 | 11:55 |
| *** holser_ has joined #tripleo | 11:55 | |
| *** dalvarez has joined #tripleo | 11:55 | |
| bogdando | so we'll need to compose the shorter version of that | 11:55 |
| bogdando | with Nova and dependencies | 11:55 |
| quiquell | bogdando: It's not quite the opposite, we have to run at puppet-nova stuff that depends on nova | 11:56 |
| quiquell | We have to test the dependants | 11:56 |
| bogdando | I mean db, mq, keystone w/o that nova can't pass tempest | 11:56 |
| bogdando | I hope mwhahaha could help with that also | 11:57 |
| quiquell | bogdando: yep we have jsut start | 11:57 |
| bogdando | I'm still cryptic with getting clear picture with those resource_registry mappings to the real activation of it | 11:57 |
| bogdando | deeper in the heat magic | 11:58 |
| bogdando | like one can include service into resource_registry but assign it to OS::Heat::None deeper the road | 11:58 |
| bogdando | magic, really | 11:58 |
| mwhahaha | What are you people talking about? | 11:58 |
| bogdando | mwhahaha: https://review.openstack.org/#/q/topic:standalone-puppet-gates+(status:open+OR+status:merged) | 11:59 |
| bogdando | but making each module, whenever it is doable, to be tested with the minimal config to pass tempest | 11:59 |
| mwhahaha | The default is fine for those repos | 11:59 |
| bogdando | w/o making puppet-keystone standalone job failing cuz of unrelevant puppet-nova issues | 11:59 |
| mwhahaha | No need to adjust it | 11:59 |
| bogdando | My point is to make it trully composable, and minimal | 12:00 |
| quiquell | mwhahaha: We have something merged that could have being prevented with standalone jobs voting | 12:00 |
| bogdando | and only run full integration for tripleo jobs | 12:00 |
| quiquell | mwhahaha: So we start with the task of using it at puppet- project gates | 12:00 |
| *** jrist has joined #tripleo | 12:00 | |
| bogdando | mwhahaha: default may not be good for puppet-ironic or puppet-horizon | 12:00 |
| sshnaidm | bogdando, if puppet-nova has an issue, most likely we'll have problems in all tripleo jobs, and we want to detect this | 12:00 |
| *** abishop has joined #tripleo | 12:01 | |
| bogdando | so we'll have to add coverage either to those modules only, or bringing the world in for all of the puppet-* modules | 12:01 |
| mwhahaha | You folks are talking about over optimizations | 12:01 |
| jrist | weshay: too early | 12:01 |
| bogdando | mwhahaha: nope | 12:01 |
| mwhahaha | We don't need that right now | 12:01 |
| bogdando | but do we need to test puppet-ironic and horizon? | 12:01 |
| bogdando | it's not in defaults for standalone | 12:01 |
| bogdando | nor can I see Nova in http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/environments/standalone/standalone-overcloud.yaml#n12 | 12:02 |
| mwhahaha | Ironic is tested with the undercloud job | 12:02 |
| bogdando | those cryptic resource registries | 12:02 |
| mwhahaha | Because that's where we use it | 12:02 |
| bogdando | I suggested to remove that job at all | 12:02 |
| bogdando | ok, what tests horizon? | 12:02 |
| mwhahaha | No | 12:02 |
| mwhahaha | Standalone | 12:02 |
| bogdando | hm | 12:02 |
| *** gfidente has joined #tripleo | 12:02 | |
| *** paramite has joined #tripleo | 12:02 | |
| mwhahaha | Horizon is deployed by default on the standalone | 12:02 |
| *** aufi has joined #tripleo | 12:03 | |
| bogdando | ok I give up on reading those http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/environments/standalone/standalone-overcloud.yaml#n45 | 12:03 |
| bogdando | I can see nor Nova nor Horizon there | 12:03 |
| bogdando | :) | 12:03 |
| mwhahaha | Because those are enabled by default | 12:03 |
| bogdando | please do the needfull folks, you have my blessing for default standalone for all puppet modules! | 12:03 |
| mwhahaha | I'll point you at the defaults later | 12:03 |
| mwhahaha | No not all | 12:03 |
| mwhahaha | Just what is there | 12:04 |
| bogdando | mwhahaha: one more thing, https://review.openstack.org/#/c/609300/3/.zuul.yaml wdyt of testing metadata changes? | 12:04 |
| mwhahaha | I'll explain later when I get to my desk | 12:04 |
| bogdando | like puppet/xyz | 12:04 |
| weshay | https://review.openstack.org/#/c/607987/ | 12:04 |
| quiquell | mwhahaha: Is the one listed here ok ? https://review.openstack.org/#/q/topic:standalone-puppet-gates | 12:04 |
| weshay | does that help cover the current issue? | 12:04 |
| mwhahaha | We do not want to test metadata.json | 12:05 |
| weshay | marios|rover, ^ | 12:05 |
| bogdando | why? | 12:05 |
| bogdando | it may break tripleo via missing RDO dependencies for some puppet moudles?.. | 12:05 |
| mwhahaha | We dont use it | 12:05 |
| bogdando | or pinned verions | 12:05 |
| mwhahaha | It won't pick up anything | 12:05 |
| bogdando | hm | 12:05 |
| bogdando | but we do pin some versions around | 12:05 |
| mwhahaha | Also prevents us bumping versikns | 12:05 |
| quiquell | weshay: we are proposing adding standalone to puppet- projects https://review.openstack.org/#/q/topic:standalone-puppet-gates | 12:06 |
| weshay | yes | 12:06 |
| bogdando | right, and don't we want run tests against bumped metadata versions? | 12:06 |
| weshay | thanks for the patches | 12:06 |
| mwhahaha | quiquell: doesn't make sense on puppet-openstack-integration | 12:06 |
| weshay | ya | 12:06 |
| mwhahaha | quiquell: the rest are fine | 12:06 |
| quiquell | mwhahaha: it's not the place for the template ? | 12:06 |
| mwhahaha | Oh maybe | 12:06 |
| weshay | mwhahaha, I don't think we have the tempest tests merged for standalone | 12:06 |
| weshay | chandankumar, is back | 12:06 |
| quiquell | mwhahaha: I am just adding the template for reuse purposes not runing there | 12:06 |
| mwhahaha | weshay: we do | 12:07 |
| weshay | scenario? | 12:07 |
| mwhahaha | quiquell: k that's fine | 12:07 |
| * weshay looks | 12:07 | |
| chandankumar | weshay: yup I am! | 12:07 |
| mwhahaha | weshay: we are just skipping some, but the basics are there | 12:07 |
| mwhahaha | We need to fix the tests to include more | 12:07 |
| quiquell | mwhahaha: Do we have to replace undercloud jobs ? | 12:07 |
| mwhahaha | quiquell: for some repos yes | 12:08 |
| mwhahaha | quiquell: not all | 12:08 |
| mwhahaha | Undercloud uses things like zaqar, Mistral, heat, ironic | 12:08 |
| mwhahaha | So we get coverage there | 12:08 |
| mwhahaha | We don't really get coverage on nova | 12:08 |
| weshay | mwhahaha, my thought.. merge https://review.openstack.org/#/c/607987/ --> merge https://review.openstack.org/#/c/606046/8/config/general_config/featureset052.yml --> merge https://review.openstack.org/#/q/topic:standalone-puppet-gates --> remove undercloud job | 12:08 |
| mwhahaha | Which is why we should add the standalone there | 12:09 |
| quiquell | mwhahaha: wich ones need undercloud ? | 12:09 |
| mwhahaha | I'll let you know in a bit when I'm not reading from my phone | 12:10 |
| quiquell | mwhahaha: ack, thanks mate | 12:10 |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 12:10 |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 12:10 |
| marios|rover | weshay: ack *you mean /#/c/607987/ ? | 12:10 |
| * mwhahaha runs away and should have gone back to sleep | 12:10 | |
| chandankumar | mwhahaha: http://logs.openstack.org/46/606046/8/check/tripleo-ci-centos-7-standalone/a263401/logs/tempest.html.gz more failure | 12:10 |
| *** dciabrin_ has joined #tripleo | 12:10 | |
| *** quiquell is now known as quiquell|lunch | 12:11 | |
| chandankumar | mwhahaha: is it expected in standalone http://logs.openstack.org/46/606046/8/check/tripleo-ci-centos-7-standalone/a263401/logs/undercloud/var/log/extra/errors.txt.gz#_2018-10-10_10_03_15_583 ? | 12:12 |
| mwhahaha | chandankumar: likely because of the puppet-nova problems, recheck | 12:12 |
| chandankumar | where is openstackgerrit bot? | 12:13 |
| mwhahaha | Missing in action | 12:13 |
| mwhahaha | Don't ask, it's silly | 12:13 |
| * Tengu asks anyway | 12:14 | |
| Tengu | btw zuul new interface is faster. | 12:15 |
| chandankumar | Tengu: All hail to tristan :-) | 12:15 |
| *** dprince has joined #tripleo | 12:15 | |
| quiquell|lunch | Tengu: but json stream url is broken :-/ the greasy monkey is broken by it | 12:16 |
| Tengu | quiquell|lunch: not using greasemonkey, so I'm sage :D | 12:17 |
| *** paramite has quit IRC | 12:17 | |
| *** paramite has joined #tripleo | 12:18 | |
| quiquell|lunch | Tengu: man you should use this https://github.com/mpeterson/openstack-greasemonkey-helpers | 12:19 |
| quiquell|lunch | Tengu: Opening a gerrit review with this make you eyes pop up | 12:19 |
| *** fultonj has joined #tripleo | 12:19 | |
| beagles | bogdando: is that from tne agent logs? | 12:22 |
| bogdando | beagles: yes | 12:22 |
| bogdando | I keep debugging other wrappers... noticed that ip netns identify returns an empty | 12:22 |
| *** paramite has quit IRC | 12:23 | |
| bogdando | that's prolly cuz I'm starting the wrapper from the agent container directly, but should do that from some netns | 12:23 |
| weshay | quiquell|lunch, curl http://zuul.openstack.org/status right? | 12:24 |
| beagles | bogdando - I think the agent runs the command as 'ip netns exec' already so this is pretty strange | 12:24 |
| beagles | bogdando: it's as if the agent container no longer has the access it once did | 12:25 |
| *** morazi has joined #tripleo | 12:29 | |
| bogdando | thats a nsenter breaks the ip netns exec https://pastebin.com/CWxankLa | 12:30 |
| bogdando | ;( | 12:30 |
| *** quiquell|lunch is now known as quiquell | 12:30 | |
| bogdando | beagles: ^^ | 12:30 |
| *** radez has joined #tripleo | 12:30 | |
| quiquell | weshay: curl http://zuul.openstack.org/api/status | 12:31 |
| bogdando | so that container, needs to be started from a nents? | 12:31 |
| quiquell | weshay: the url for running jobs are wrong | 12:31 |
| beagles | bogdando: technically no, but that's how neutron will execute it | 12:31 |
| beagles | bogdando: what's a bit weird though is that we are calling ip netns identify from within a call to nsenter | 12:32 |
| beagles | bogdando: but also that wouldn't be the agent logs that would be coming from elsewhere | 12:33 |
| bogdando | beagles: no, we do not, apparently it is my bad testing | 12:34 |
| bogdando | we only do for podman | 12:34 |
| beagles | bogdando: it looks like the agent can't run its own operations for namespaces - this doesn't even touch sidecar stuff yet | 12:34 |
| beagles | bogdando: unless calling nsenter at some point breaks the namespaces (we've seen fragility in network namespaces before) | 12:35 |
| bogdando | but that is done at the end of the wrapper script, as a forking call | 12:35 |
| bogdando | podman forks and exits | 12:35 |
| beagles | bogdando: I don't know -I guess what I'm thinking is that neutron_dhcp_agent is itself broken, not the sidecars | 12:37 |
| *** ykarel__ is now known as ykarel | 12:38 | |
| bogdando | oh, well, then I'll need some help with testing the topic, beagles | 12:38 |
| beagles | bogdando: one test would be to restart the neutron_dhcp_agent without the wrappers mounted | 12:38 |
| bogdando | will try that | 12:38 |
| beagles | bogdando: if it works then we can blame the wrappers | 12:38 |
| *** amoralej` is now known as amoralej|lunch | 12:38 | |
| beagles | bogdando: if not then maybe something funky with paunch/how the current containers are run | 12:39 |
| *** rlandy has joined #tripleo | 12:39 | |
| *** vkmc has joined #tripleo | 12:40 | |
| *** sileht has left #tripleo | 12:41 | |
| *** fultonj has quit IRC | 12:42 | |
| *** bdodd_ has quit IRC | 12:42 | |
| *** bdodd has joined #tripleo | 12:43 | |
| *** udesale has joined #tripleo | 12:45 | |
| *** mcornea has joined #tripleo | 12:51 | |
| *** pdeore has joined #tripleo | 12:56 | |
| bogdando | beagles: still having perm denied w/o wrappers :( | 12:59 |
| beagles | bogdando: ahh | 13:00 |
| bogdando | so is it podman related prolly... | 13:00 |
| bogdando | will try with docker | 13:00 |
| beagles | bogdando: yeah. | 13:01 |
| beagles | bogdando: are the podman agent containers not run as privileged? | 13:01 |
| *** ansmith has joined #tripleo | 13:02 | |
| beagles | bogdando: if not, the we might need to add some additional capabilities, etc | 13:02 |
| * beagles doesnt recall exactly what happened there - will go hunting pauch patch | 13:02 | |
| bogdando | they do | 13:02 |
| *** rbrady has joined #tripleo | 13:02 | |
| bogdando | beagles: not really more than alias docker=paunch :) | 13:02 |
| beagles | bogdando: ah okay | 13:03 |
| bogdando | beagles: hmm, same stuff | 13:04 |
| bogdando | did it ever work? :) | 13:04 |
| beagles | bogdando: with docker it doesn't work ? | 13:05 |
| beagles | fricking weird | 13:05 |
| bogdando | beagles: same permission denies | 13:05 |
| beagles | selinux? | 13:05 |
| bogdando | permissive... | 13:05 |
| bogdando | may be a netns got hossed? | 13:05 |
| bogdando | how can I clean it up? | 13:05 |
| beagles | bogdando: yeah | 13:06 |
| beagles | bogdando: reboot basically I think | 13:06 |
| bogdando | um okay ) | 13:06 |
| beagles | ikr | 13:06 |
| *** lblanchard has joined #tripleo | 13:07 | |
| *** aufi has quit IRC | 13:08 | |
| *** shyam89 has quit IRC | 13:08 | |
| *** tzumainn has joined #tripleo | 13:08 | |
| *** shyam89 has joined #tripleo | 13:08 | |
| *** aufi has joined #tripleo | 13:09 | |
| bogdando | beagles: ugh, it has 0000 | 13:10 |
| bogdando | nice access pattern | 13:10 |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 13:10 |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 13:10 |
| bogdando | beagles: does that normally happens to those qdhcp-* ? :) | 13:10 |
| beagles | bogdando: nope | 13:10 |
| beagles | bogdando: we used to see wierd namespace issues when we weren't mounting /var/run/netns properly | 13:11 |
| beagles | bogdando: can you delete the namespace manually? | 13:11 |
| *** kopecmartin|scho is now known as kopecmartin|ruck | 13:13 | |
| bogdando | chmoded it, rebooting now | 13:14 |
| beagles | marios|rover: bandini : where is the task for updating all the packages update/upgrade these days? | 13:14 |
| beagles | bogdando: ack | 13:14 |
| *** shyam89 has quit IRC | 13:14 | |
| * beagles declares ns's magic, burns some sage in support of bogdando | 13:15 | |
| marios|rover | beagles: in upgrade tasks last i knew :)? | 13:15 |
| beagles | marios|rover: k I'll look there :) | 13:15 |
| marios|rover | https://github.com/openstack/tripleo-heat-templates/blob/ec227891bd5508a13312449d27265344f831f97c/puppet/services/tripleo-packages.yaml#L95 | 13:15 |
| marios|rover | beagles: ^ | 13:15 |
| * bogdando sees sage's burning in screems | 13:15 | |
| *** hkominos has joined #tripleo | 13:16 | |
| bogdando | I hope that works for god of ns's | 13:16 |
| *** holser_ has quit IRC | 13:16 | |
| beagles | :) | 13:16 |
| *** aufi has quit IRC | 13:21 | |
| bogdando | beagles: yes, worked well, even works now with podman wrappers | 13:22 |
| beagles | bogdando: woo hoo | 13:22 |
| bogdando | so it's ready for review and testing :) | 13:22 |
| beagles | bogdando: thanks 10^6 man | 13:22 |
| bogdando | thanks for helping with debugs beagles | 13:23 |
| *** holser_ has joined #tripleo | 13:23 | |
| *** aufi has joined #tripleo | 13:25 | |
| hkominos | Hi all. Quick question. Is there an easy way to bypass the default container source (docker.io/tripleomaster) when trying to create the undercloud ?? | 13:27 |
| hjensas | bogdando: Do we have support for retries in docker_config? I.e https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/ironic-inspector.yaml#L158 ? | 13:29 |
| *** holser_ has quit IRC | 13:30 | |
| bogdando | hjensas: AFAICT docker-puppet.py does not retry | 13:30 |
| bogdando | dprince: around perchance? ^^ | 13:30 |
| *** gfidente has quit IRC | 13:31 | |
| dprince | bogdando: hi, whats up | 13:31 |
| dprince | bogdando: docker-puppet.py retries the 'docker pull' | 13:31 |
| dprince | bogdando: but not the actual 'puppet apply' command | 13:31 |
| bogdando | yeah, dprince thanks for info! hjensas^^ | 13:32 |
| dprince | I'm not sure we want it to retry that. If it fails once it is very likley to fail again and that is just wasting time to report the underlying failure | 13:32 |
| * bogdando tends to agree | 13:32 | |
| bogdando | hjensas: you can put retries into curl | 13:33 |
| bogdando | or the script itself?.. | 13:34 |
| weshay | marios|rover, kopecmartin|ruck have we seen this before? http://logs.openstack.org/30/607530/11/check/tripleo-ci-centos-7-containers-multinode/438b762/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 13:34 |
| hjensas | bogdando: yes, curl can retry if it gets a response i.e 4xx or 5xx, but not for http://paste.openstack.org/show/731851/ | 13:34 |
| hjensas | bogdando: curl in Fedora can retry on ECONNREFUSED as well, but not RHEL. | 13:35 |
| weshay | marios|rover, kopecmartin|ruck /me looking at the results for https://review.openstack.org/607530 | 13:35 |
| weshay | which we neeeed to merge | 13:35 |
| bogdando | oops | 13:35 |
| weshay | http://logs.openstack.org/30/607530/11/check/tripleo-ci-centos-7-containers-multinode/438b762/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-10-10_12_59_13 | 13:35 |
| *** trown is now known as trown|afk | 13:35 | |
| bogdando | may be the task can be converted into ansible? with proper retrying | 13:35 |
| bogdando | hjensas: | 13:35 |
| weshay | 2018-10-10 12:59:13 | "2018-10-10 12:57:22,363 ERROR: 19482 -- Failed running docker-puppet.py for nova_libvirt", | 13:35 |
| weshay | 2018-10-10 12:59:13 | "2018-10-10 12:57:22,363 ERROR: 19482 -- Notice: hiera(): Cannot load backend module_data: cannot load such file -- hiera/backend/module_data_backend", | 13:35 |
| weshay | that is the other fix for puppet I guess | 13:36 |
| weshay | so yes we have seen it | 13:36 |
| *** fultonj has joined #tripleo | 13:36 | |
| weshay | marios|rover, kopecmartin|ruck is the the fix? https://review.openstack.org/#/c/609289/ | 13:36 |
| weshay | yup | 13:37 |
| hjensas | bogdando: yes, good idea. Thanks! Will try that. | 13:37 |
| weshay | I'm up to speed now | 13:37 |
| marios|rover | weshay: sorry was momentarily afk reading back | 13:38 |
| weshay | marios|rover, I think I got the flow now :) | 13:38 |
| *** holser_ has joined #tripleo | 13:38 | |
| marios|rover | weshay: yeah that one was fixed by quiquell++ with help from Tengu++ very early today | 13:38 |
| marios|rover | i was like 'good morning' quiquell was like 'gates are broken' | 13:39 |
| Tengu | :) | 13:39 |
| Tengu | and in the end we were like "woohooo we fixed it" | 13:40 |
| Tengu | :) | 13:40 |
| weshay | marios|rover, Tengu kopecmartin|ruck so now we just need https://review.openstack.org/#/c/608589/ to land | 13:40 |
| * weshay is reseting the job | 13:40 | |
| marios|rover | weshay: yeah ssl one | 13:40 |
| *** ade_lee has joined #tripleo | 13:40 | |
| marios|rover | weshay: thats the one the ovb jobs were hitting | 13:41 |
| marios|rover | weshay: so blocking promotion | 13:41 |
| weshay | right | 13:41 |
| *** hkominos has quit IRC | 13:41 | |
| matbu | marios|rover: weshay hey o/ can i have a quick review on this plz https://review.openstack.org/#/c/606087 ? | 13:41 |
| *** holser_ has quit IRC | 13:41 | |
| * Tengu just found some really "nice" issue in mistral containers using podman+skopeo | 13:41 | |
| marios|rover | matbu: ack added to my reviews list | 13:42 |
| d0ugal | Sounds interesting! | 13:42 |
| Tengu | -.-' took some time, but in the end, I have something. | 13:42 |
| d0ugal | Tengu: What did you find? | 13:42 |
| Tengu | d0ugal: https://bugs.launchpad.net/tripleo/+bug/1797114 if you're interested :) | 13:42 |
| openstack | Launchpad bug 1797114 in tripleo "running skopeo in podman fails with "Error inspecting image"" [Medium,Triaged] - Assigned to Emilien Macchi (emilienm) | 13:42 |
| d0ugal | Tengu: thanks | 13:42 |
| Tengu | in the end it's a "simple" permission denied, although it's probably not "only" that. | 13:42 |
| Tengu | but at least I get the right error now, need to understand why it works without the /run:/run though. | 13:43 |
| *** amoralej|lunch is now known as amoralej | 13:44 | |
| *** holser_ has joined #tripleo | 13:45 | |
| *** apetrich has joined #tripleo | 13:46 | |
| mwhahaha | bogdando: so the default services for a deploy are, https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud-resource-registry-puppet.j2.yaml#L104-L358 | 13:48 |
| *** vinaykns has joined #tripleo | 13:48 | |
| mwhahaha | bogdando: if they are present in the role | 13:48 |
| d0ugal | Tengu: Good work tracking it down, looks confusing to me :) | 13:49 |
| mwhahaha | bogdando: we turn off services that are enabled by default in the standalone via, https://github.com/openstack/tripleo-heat-templates/blob/master/environments/standalone/standalone-tripleo.yaml#L52-L104 | 13:49 |
| Tengu | d0ugal: well, debugging containers is a pain ;). | 13:49 |
| Tengu | d0ugal: and I kind of updated the issue while finding things so that it's tracked down with the process of finding things. | 13:49 |
| mwhahaha | bogdando: so you if you wanted to enable/disable one of the services then you would provide an environment file that overrides the none setting or set it to none | 13:49 |
| *** mjturek has joined #tripleo | 13:50 | |
| *** ykarel is now known as ykarel|afk | 13:51 | |
| *** aufi has quit IRC | 13:52 | |
| bogdando | mwhahaha: thanks! I knew of that file, just the cryptic kind of that knowledge needs its constant refreshing! :) | 13:52 |
| mwhahaha | yea, love that complexity :D | 13:52 |
| *** holser_ has quit IRC | 13:55 | |
| *** rbrady has quit IRC | 14:01 | |
| *** agurenko has quit IRC | 14:01 | |
| *** trozet has joined #tripleo | 14:01 | |
| Tengu | d0ugal: in the end, I'm pretty sure it's a skopeo/libpod bug :). Will discuss that on #podman. | 14:01 |
| d0ugal | Tengu: k | 14:01 |
| *** slagle has joined #tripleo | 14:04 | |
| *** lblanchard has quit IRC | 14:05 | |
| *** ykarel_ has joined #tripleo | 14:06 | |
| quiquell | mwhahaha, bogdando: for standalone at puppet-nova do I remove undercloud ? | 14:07 |
| mwhahaha | yea it would be fine | 14:08 |
| quiquell | mwhahaha: Do we cover same at tempest ? | 14:08 |
| mwhahaha | more so in the standalone | 14:09 |
| quiquell | mwhahaha: fair enough | 14:09 |
| *** ykarel|afk has quit IRC | 14:09 | |
| *** ykarel_ is now known as ykarel|afk | 14:09 | |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 14:10 |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 14:10 |
| quiquell | mwhahaha, bogdando: Done https://review.openstack.org/#/c/609301 | 14:11 |
| quiquell | mwhahaha: Should I remove the ^metadata.json$ linet at the Depends-On change ? | 14:12 |
| mwhahaha | quiquell: no leave it | 14:12 |
| quiquell | mwhahaha: ack | 14:13 |
| *** dtantsur is now known as dtantsur|brb | 14:13 | |
| *** quiquell is now known as quiquell|off | 14:14 | |
| chandankumar | kopecmartin|ruck: Hello | 14:15 |
| chandankumar | kopecmartin|ruck: for above tempest bug http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-undercloud-containers | 14:15 |
| chandankumar | kopecmartin|ruck: is the failure coming multiple times? | 14:16 |
| *** fultonj has quit IRC | 14:17 | |
| kopecmartin|ruck | chandankumar, i have no idea, define multiple times :D i can see a failure on the page you sent three times | 14:21 |
| bogdando | quiquell|off: let's please collect all under https://review.openstack.org/#/q/topic:standalone-puppet-gates+(status:open+OR+status:merged) | 14:22 |
| bogdando | I wanted to start that mail thread... | 14:22 |
| bogdando | feel not happy with the default standalone bombing all the puppet modules with full setup :) | 14:22 |
| chandankumar | kopecmartin|ruck: other two are failed due to different reason | 14:22 |
| jaosorior | bogdando: what does the full setup include? | 14:23 |
| bogdando | to know that for sure you'll need a superability to merge yamls in your head | 14:23 |
| chandankumar | kopecmartin|ruck: I will dig into the bug once it is appears one more time | 14:23 |
| * mwhahaha pokes weshay | 14:24 | |
| mwhahaha | weshay: you free? | 14:24 |
| bogdando | jaosorior: | 14:24 |
| bogdando | 3:48:35 PM GMT+2 - mwhahaha: bogdando: so the default services for a deploy are, https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud-resource-registry-puppet.j2.yaml#L104-L358 | 14:24 |
| bogdando | 3:48:46 PM GMT+2 - mwhahaha: bogdando: if they are present in the role | 14:24 |
| bogdando | 3:49:21 PM GMT+2 - mwhahaha: bogdando: we turn off services that are enabled by default in the standalone via, https://github.com/openstack/tripleo-heat-templates/blob/master/environments/standalone/standalone-tripleo.yaml#L52-L104 | 14:24 |
| bogdando | 3:49:58 PM GMT+2 - mwhahaha: bogdando: so you if you wanted to enable/disable one of the services then you would provide an environment file that overrides the none setting or set it to none | 14:24 |
| weshay | mwhahaha, sorry.. talking to amnan | 14:24 |
| mwhahaha | k | 14:24 |
| *** roger2 has joined #tripleo | 14:24 | |
| mwhahaha | weshay: maybe we can chat after cix meeting | 14:25 |
| bogdando | jaosorior: so I'd say for each particular module there is a most likely unrelated things get deployed, and less likely, there is a chance to not cover that module at all | 14:26 |
| dpeacock | mwhahaha: I'm attending cix today | 14:26 |
| *** fultonj has joined #tripleo | 14:26 | |
| *** fultonj has quit IRC | 14:26 | |
| weshay | k | 14:27 |
| jaosorior | bogdando: understood. What's your suggestion? | 14:29 |
| roger2 | My "openstack undercloud install" failed with "ERROR: Network create/update failed." and "504 Gateway Time-out". Should I just re-run the install command and see if it will get past it the next time? | 14:32 |
| *** trown|afk is now known as trown | 14:35 | |
| *** mfedosin has quit IRC | 14:38 | |
| roger2 | undercloud.conf and last 100 lines of install-undercloud.log: https://pastebin.com/T9Pwdec3 | 14:41 |
| Tengu | hmm is this known already, or transcient, or... ? http://logs.openstack.org/57/607557/10/check/tripleo-ci-centos-7-undercloud-containers/9d80c65/logs/undercloud/home/zuul/tempest.log.txt.gz | 14:45 |
| Tengu | chandankumar: maybe? -^^ (as related to tempest apparently) | 14:45 |
| *** rbrady has joined #tripleo | 14:46 | |
| Tengu | ah. well. ok. it's known :D | 14:47 |
| *** abishop has quit IRC | 14:51 | |
| *** skramaja has quit IRC | 14:51 | |
| bogdando | mwhahaha, quiquell|off, weshay: http://lists.openstack.org/pipermail/openstack-dev/2018-October/135644.html | 14:53 |
| bogdando | jaosorior: ^^ | 14:53 |
| *** chandankumar is now known as chkumar|off | 14:55 | |
| bogdando | jistr, shardy: ^^ please share your ideas :) | 14:55 |
| bogdando | It's so pity to see the composability not used | 14:56 |
| *** iurygregory has quit IRC | 14:57 | |
| *** iurygregory has joined #tripleo | 14:59 | |
| *** ramishra has quit IRC | 15:03 | |
| *** pdeore has quit IRC | 15:05 | |
| *** agurenko has joined #tripleo | 15:07 | |
| weshay | mwhahaha, k.. sorry.. ready when ever | 15:07 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 15:10 |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 15:10 |
| kopecmartin|ruck | marios|rover, weshay it looks like tripleo-ci-centos-7-undercloud-oooq gate job is affected by this old issue https://bugs.launchpad.net/tripleo/+bug/1764777 | 15:13 |
| openstack | Launchpad bug 1764777 in tripleo "queens-uc-newton-oc undercloud install fails on creating default plan" [High,Triaged] | 15:13 |
| *** panda has quit IRC | 15:13 | |
| *** panda has joined #tripleo | 15:14 | |
| marios | kopecmartin|ruck: ack | 15:14 |
| weshay | kopecmartin|ruck, on this patch? https://review.openstack.org/#/c/608324/1 | 15:15 |
| kopecmartin|ruck | weshay, yes | 15:15 |
| marios | weshay: yeah in the gate but passed check | 15:15 |
| weshay | ya | 15:16 |
| weshay | kopecmartin|ruck, nice job.. so if it fails the gate, my advice is to add alert, promotion-blocker | 15:17 |
| weshay | blocks queens | 15:17 |
| *** holser_ has joined #tripleo | 15:18 | |
| kopecmartin|ruck | weshay, ok, I've added the tags | 15:19 |
| weshay | apetrich, you available to look at a mistral bug? | 15:19 |
| d0ugal | weshay: I can take a look | 15:19 |
| weshay | thanks d0ugal https://bugs.launchpad.net/tripleo/+bug/1764777 | 15:19 |
| openstack | Launchpad bug 1764777 in tripleo "queens-uc-newton-oc undercloud install fails on creating default plan" [High,Triaged] | 15:19 |
| weshay | thanks kopecmartin|ruck | 15:19 |
| mwhahaha | weshay: i got like 10 mins, you still free? | 15:22 |
| weshay | ya | 15:22 |
| *** jrist has quit IRC | 15:23 | |
| bogdando | beagles, Tengu: attempted to test the rootwrappers with Enforcing SELinux, failed miserably, put it back to permissive, rebooted and observed a miracle https://pastebin.com/x91f002d | 15:23 |
| *** agopi is now known as agopi|lunch | 15:23 | |
| bogdando | isn't that god of ns'es a tricky guy? | 15:24 |
| *** Petersingh is now known as Petersingh|gone | 15:24 | |
| *** Petersingh|gone has quit IRC | 15:24 | |
| *** holser_ has quit IRC | 15:27 | |
| bogdando | how come that /run/netns disappears w/o being recreated? :D | 15:27 |
| *** aufi has joined #tripleo | 15:28 | |
| beagles | bogdando: pretty cool... don't think I've ever heard of /run/netns not existing before though | 15:28 |
| bogdando | :D | 15:29 |
| d0ugal | weshay: The second report (comment 7) is a different error than the one in the original description | 15:29 |
| d0ugal | I don't have enough details to figure out why the original error happened | 15:30 |
| weshay | ah k | 15:30 |
| d0ugal | but the more recent one is just a swift timeout | 15:30 |
| weshay | d0ugal, ok.. kopecmartin|ruck can we can a new bug on the job that currently failed | 15:30 |
| weshay | d0ugal, we're focused on the gate failure for queens | 15:30 |
| d0ugal | weshay: k | 15:30 |
| weshay | sorry about that | 15:30 |
| d0ugal | np | 15:30 |
| d0ugal | weshay: The tripleo-common code should probably retry the swift upload on failure. I can try and improve that tomorrow (running out of time today) | 15:31 |
| d0ugal | but I guess it is unlikely to be a consistent failure | 15:31 |
| kopecmartin|ruck | weshay, d0ugal ok, sorry, I'll create a new bug | 15:33 |
| *** mburned is now known as mburned_out | 15:33 | |
| *** aufi has quit IRC | 15:33 | |
| bogdando | do you know something of that poor snmp thing failing rspecs? mwhahaha? http://logs.openstack.org/07/606907/1/check/puppet-openstack-unit-4.8-centos-7/fdaa62d/job-output.txt.gz | 15:33 |
| mwhahaha | bogdando: many a bump in snmp module broke something? | 15:34 |
| mwhahaha | i'll look later | 15:34 |
| bogdando | thanks a bunch | 15:35 |
| *** iurygregory has quit IRC | 15:35 | |
| *** iurygregory has joined #tripleo | 15:36 | |
| *** jfrancoa has quit IRC | 15:37 | |
| *** ksambor has quit IRC | 15:38 | |
| *** jcoufal has joined #tripleo | 15:39 | |
| *** yprokule has quit IRC | 15:46 | |
| *** agurenko has quit IRC | 15:46 | |
| kopecmartin|ruck | weshay, ok, I've copied it to a new bug https://bugs.launchpad.net/tripleo/+bug/1797167 | 15:49 |
| openstack | Launchpad bug 1797167 in tripleo "swift timeout during undercloud deploy" [Undecided,New] | 15:49 |
| kopecmartin|ruck | weshay, can you please set it as Triaged? I need to ping someone because of the permissions to do it | 15:50 |
| *** leanderthal has quit IRC | 15:50 | |
| *** jcoufal has quit IRC | 15:50 | |
| *** morazi has quit IRC | 15:51 | |
| *** naturalblue has quit IRC | 15:52 | |
| *** udesale has quit IRC | 15:57 | |
| *** sshnaidm has quit IRC | 15:58 | |
| d0ugal | kopecmartin|ruck: I updated the status | 15:58 |
| *** sshnaidm has joined #tripleo | 15:59 | |
| *** rdopiera has quit IRC | 16:01 | |
| *** bogdando has quit IRC | 16:03 | |
| *** akrivoka_ has quit IRC | 16:08 | |
| *** akrivoka_ has joined #tripleo | 16:09 | |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 16:10 |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 16:10 |
| *** ykarel|afk is now known as ykarel | 16:13 | |
| *** abishop has joined #tripleo | 16:13 | |
| *** gfidente has joined #tripleo | 16:15 | |
| *** dtantsur|brb is now known as dtantsur | 16:15 | |
| weshay | kopecmartin|ruck, k | 16:20 |
| chkumar|off | Tengu: the tempest failure seems odd to me, is it continously coming? | 16:22 |
| *** akrivoka_ has quit IRC | 16:29 | |
| *** gfidente[m] has joined #tripleo | 16:29 | |
| *** ykarel_ has joined #tripleo | 16:30 | |
| apetrich | weshay, aye | 16:30 |
| apetrich | oh d0ugal has looked at it | 16:31 |
| *** naturalblue has joined #tripleo | 16:31 | |
| weshay | thanks | 16:32 |
| *** ykarel has quit IRC | 16:32 | |
| *** jpich has quit IRC | 16:33 | |
| *** hjensas has quit IRC | 16:38 | |
| *** vinaykns has quit IRC | 16:41 | |
| *** shardy has quit IRC | 16:44 | |
| *** cgoncalves has quit IRC | 16:49 | |
| *** cgoncalves has joined #tripleo | 16:49 | |
| *** ykarel__ has joined #tripleo | 16:52 | |
| *** ykarel_ has quit IRC | 16:56 | |
| *** ykarel_ has joined #tripleo | 16:56 | |
| *** ykarel__ has quit IRC | 16:58 | |
| *** trown is now known as trown|lunch | 16:59 | |
| *** ykarel_ has quit IRC | 17:02 | |
| *** derekh has quit IRC | 17:03 | |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 17:10 |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797167 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 17:10 |
| openstack | Launchpad bug 1797167 in tripleo "swift timeout during undercloud deploy" [Critical,Triaged] | 17:10 |
| *** agopi|lunch is now known as agopi | 17:25 | |
| *** psachin has quit IRC | 17:28 | |
| *** dtantsur is now known as dtantsur|afk | 17:34 | |
| mwhahaha | wheens undercloud upgrades job is broken, do we have a bug for that? http://logs.openstack.org/24/608324/1/check/tripleo-ci-centos-7-undercloud-upgrades/1d06342/logs/undercloud/home/zuul/undercloud_upgrade.log.txt.gz#_2018-10-10_13_16_08 | 17:35 |
| mwhahaha | therve: -^ fyi do you know about the policy.json issue? | 17:35 |
| *** morazi has joined #tripleo | 17:37 | |
| *** salmankhan has quit IRC | 17:39 | |
| *** Vorrtex has joined #tripleo | 17:40 | |
| weshay | https://review.rdoproject.org/zuul/status | 17:45 |
| *** salmankhan has joined #tripleo | 17:52 | |
| *** pcaruana has quit IRC | 17:55 | |
| nhicher | weshay, rlandy: the job on vexxhost failed with tls-cert-inject.yaml error https://logs.rdoproject.org/96/15896/37/check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master-vexxhost/a891b3f/job-output.txt.gz#_2018-10-10_13_56_47_936340. Do you have the same error on others jobs ? | 17:58 |
| *** salmankhan has quit IRC | 17:58 | |
| weshay | nhicher, I sent you that review yesterday I thought | 17:59 |
| nhicher | weshay: yes, I checked tripleo-quickstart-extra on the nodepool slave, the tls review is merged, but job failed | 17:59 |
| nhicher | weshay: same error on rdocloud too https://review.rdoproject.org/r/#/c/15896/ | 18:01 |
| *** apetrich has quit IRC | 18:03 | |
| *** apetrich has joined #tripleo | 18:04 | |
| roger2 | I'm trying to deploy rocky release but it fails. Is there simple way to give up and try queens without reinstalling a clean OS? I assume answer is similar to following upgrade instructions here https://docs.openstack.org/tripleo-docs/latest/install/installation/installation.html#updating-undercloud-components | 18:07 |
| weshay | nhicher, not merged https://review.openstack.org/#/c/608589/ | 18:07 |
| weshay | roger2, you don't need to reinstall the os | 18:09 |
| roger2 | weshay: ok thx. | 18:10 |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 18:10 |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797167 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 18:10 |
| openstack | Launchpad bug 1797167 in tripleo "swift timeout during undercloud deploy" [Critical,Triaged] | 18:10 |
| nhicher | weshay: thanks, I will add a depends-on | 18:10 |
| weshay | toure, what happened here? http://logs.openstack.org/89/608589/5/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/3a5c058/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-10-10_15_50_02 | 18:11 |
| *** pcaruana has joined #tripleo | 18:12 | |
| *** itlinux has quit IRC | 18:13 | |
| * toure looks | 18:14 | |
| *** lblanchard has joined #tripleo | 18:14 | |
| weshay | mwhahaha, any idea wtf this is? http://logs.openstack.org/89/608589/5/check/tripleo-ci-centos-7-scenario002-multinode-oooq-container/3a5c058/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-10-10_15_50_02 | 18:15 |
| weshay | before I recheck | 18:15 |
| toure | weshay that bug should be fixed | 18:16 |
| weshay | what bug? | 18:17 |
| toure | websocket timeout with mistral | 18:17 |
| toure | it was due to log-rotate | 18:17 |
| toure | logrotate postscript | 18:17 |
| *** raildo has quit IRC | 18:17 | |
| weshay | ah.. I wonder | 18:17 |
| * toure shakes fist at container management | 18:18 | |
| toure | weshay https://bugs.launchpad.net/tripleo/+bug/1789680 | 18:19 |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Fix committed] - Assigned to Toure Dunnon (toure) | 18:19 |
| *** panda has quit IRC | 18:20 | |
| toure | weshay so the purposed fix was pushed to the client but I had a suspicion that this fix should have been placed into the api service directly | 18:21 |
| *** panda has joined #tripleo | 18:23 | |
| weshay | toure, hrm.. wondering if the proper version of mistral has not been promoted | 18:24 |
| * toure looking at mistral version | 18:25 | |
| *** raildo has joined #tripleo | 18:26 | |
| toure | weshay looks like it is an older package 20180806115446 | 18:28 |
| weshay | toure, ya.. so we need a promotion | 18:29 |
| toure | weshay just missed the fix, the job has mistral 7.0.1 and the fix went into 7.0.3 | 18:30 |
| toure | yeah | 18:30 |
| d0ugal | Why would a mistral promotion help? | 18:30 |
| d0ugal | I think I'm missing something | 18:30 |
| toure | to include the merged fix | 18:30 |
| d0ugal | toure: ah, which fix? | 18:30 |
| toure | rpc reset | 18:31 |
| d0ugal | gotcha | 18:31 |
| toure | https://review.openstack.org/605633 | 18:31 |
| *** trown|lunch is now known as trown | 18:34 | |
| *** roger2 has quit IRC | 18:34 | |
| d0ugal | toure, weshay: it could also just be that it took longer than the timeout | 18:35 |
| d0ugal | as the message says :) | 18:35 |
| d0ugal | https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/workflows/deployment.py#L52 | 18:35 |
| *** roger2 has joined #tripleo | 18:36 | |
| d0ugal | From my reading of the mistral logs it took almost exactly 10 mins | 18:36 |
| d0ugal | and I think we only wait 6 mins? | 18:36 |
| toure | d0ugal ah, I thought we waited longer than that | 18:40 |
| toure | weshay | 18:41 |
| toure | d0ugal weshay do you know if latency is captured in the logs I see route tables and ports | 18:43 |
| d0ugal | no idea | 18:43 |
| weshay | toure, all that kind of data is in /var/log/extras | 18:44 |
| weshay | but not sure if we have anything that would capture latency | 18:44 |
| weshay | maybe the dstat | 18:44 |
| toure | link status is fine | 18:44 |
| toure | by link stats I mean there any errors on the tx or rx sid | 18:45 |
| toure | side | 18:45 |
| *** pcaruana has quit IRC | 19:03 | |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797167 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 19:10 |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 19:10 |
| openstack | Launchpad bug 1797167 in tripleo "swift timeout during undercloud deploy" [Critical,Triaged] | 19:10 |
| *** kopecmartin|ruck has quit IRC | 19:27 | |
| *** ssbarnea has quit IRC | 19:29 | |
| *** dciabrin_ has quit IRC | 19:40 | |
| *** Vorrtex has quit IRC | 19:46 | |
| *** colonwq has joined #tripleo | 19:48 | |
| *** zaneb has quit IRC | 19:48 | |
| *** pcaruana has joined #tripleo | 19:55 | |
| *** pcaruana has quit IRC | 20:06 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 20:10 |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797167 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 20:10 |
| openstack | Launchpad bug 1797167 in tripleo "swift timeout during undercloud deploy" [Critical,Triaged] | 20:10 |
| *** divergence has joined #tripleo | 20:16 | |
| *** rh-jelabarre has quit IRC | 20:17 | |
| *** rh-jelabarre has joined #tripleo | 20:17 | |
| *** aedc has quit IRC | 20:20 | |
| *** dprince has quit IRC | 20:22 | |
| *** mcornea has quit IRC | 20:24 | |
| *** mcornea has joined #tripleo | 20:27 | |
| *** aedc has joined #tripleo | 20:32 | |
| *** ansmith has quit IRC | 20:35 | |
| *** abishop has quit IRC | 20:46 | |
| *** itlinux has joined #tripleo | 20:46 | |
| *** aedc has quit IRC | 20:47 | |
| *** aedc has joined #tripleo | 20:47 | |
| *** lblanchard has quit IRC | 20:49 | |
| *** aedc has quit IRC | 20:56 | |
| *** boazel has quit IRC | 21:00 | |
| *** mjturek has quit IRC | 21:00 | |
| *** slaweq has quit IRC | 21:04 | |
| *** dmsimard has joined #tripleo | 21:08 | |
| *** dmsimard has left #tripleo | 21:08 | |
| *** dtrainor_ has quit IRC | 21:09 | |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 21:10 |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797167 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 21:10 |
| openstack | Launchpad bug 1797167 in tripleo "swift timeout during undercloud deploy" [Critical,Triaged] | 21:10 |
| *** slaweq has joined #tripleo | 21:11 | |
| *** trown is now known as trown|outtypewww | 21:13 | |
| *** dhill_ has quit IRC | 21:13 | |
| *** raildo has quit IRC | 21:14 | |
| *** kopecmartin has joined #tripleo | 21:14 | |
| *** slaweq has quit IRC | 21:16 | |
| *** ssbarnea has joined #tripleo | 21:18 | |
| *** dhill_ has joined #tripleo | 21:19 | |
| *** dtrainor_ has joined #tripleo | 21:29 | |
| bnemec | Working from a local checkout of the templates and getting <urlopen error [Errno 2] No such file or directory: '/home/centos/templates/environments/network-isolation.yaml'> | 21:31 |
| *** kopecmartin has quit IRC | 21:32 | |
| bnemec | Shouldn't that file be generated during template processing? | 21:32 |
| bnemec | If not, how do you use the jinja-fied net-iso environments? | 21:32 |
| itlinux | is there an upgrade process from undercloud to undercloud container? | 21:32 |
| *** sai_p has joined #tripleo | 21:41 | |
| *** mcornea has quit IRC | 21:41 | |
| mwhahaha | bnemec: process-templates.py i think, you can pass a roles data and network data in | 21:41 |
| *** roger2 has quit IRC | 21:43 | |
| *** ssbarnea has quit IRC | 21:45 | |
| bnemec | That's a pain. So you have to remember to manually re-run that every time you change anything with your networking or roles? | 21:47 |
| mwhahaha | i'm not completely sure, but i want to say yes? though it should find the .j2 and process it | 21:47 |
| mwhahaha | though i haven't tried it recently | 21:48 |
| *** raildo has joined #tripleo | 21:53 | |
| *** raildo has quit IRC | 21:54 | |
| *** salmankhan has joined #tripleo | 21:59 | |
| *** toure is now known as toure|gone | 22:00 | |
| *** gfidente has quit IRC | 22:06 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 22:10 |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797167 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 22:10 |
| openstack | Launchpad bug 1797167 in tripleo "swift timeout during undercloud deploy" [Critical,Triaged] | 22:10 |
| *** boazel has joined #tripleo | 22:11 | |
| *** apetrich has quit IRC | 22:12 | |
| *** tosky has quit IRC | 22:19 | |
| *** apetrich has joined #tripleo | 22:31 | |
| *** rlandy has quit IRC | 22:33 | |
| *** sshnaidm is now known as sshnaidm|afk | 22:33 | |
| *** jtomasek has quit IRC | 22:36 | |
| weshay | d0ugal, toure|gone another gate reset http://logs.openstack.org/19/605419/14/gate/tripleo-ci-centos-7-scenario001-multinode-oooq-container/8783d8e/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-10-10_21_55_19 | 22:37 |
| *** rcernin has joined #tripleo | 22:41 | |
| *** lblanchard has joined #tripleo | 22:44 | |
| *** salmankhan has quit IRC | 22:48 | |
| *** lblanchard has quit IRC | 22:57 | |
| *** lblanchard has joined #tripleo | 23:09 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1789680 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796710 | 23:10 |
| openstack | Launchpad bug 1789680 in tripleo "mistral MessagingTimeout correlates with containerized undercloud uptime" [Critical,Triaged] - Assigned to Toure Dunnon (toure) | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1796756 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1797167 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] | 23:10 |
| openstack | Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 23:10 |
| openstack | Launchpad bug 1797167 in tripleo "swift timeout during undercloud deploy" [Critical,Triaged] | 23:10 |
| *** lblanchard has quit IRC | 23:12 | |
| *** zaneb has joined #tripleo | 23:18 | |
| *** lblanchard has joined #tripleo | 23:40 | |
| *** sai_p has quit IRC | 23:50 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
