| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK https://review.openstack.org/430277 | 00:00 |
|---|---|---|
| *** cwolferh has quit IRC | 00:00 | |
| fpan | EmilienM: ah good point, thanks for the fix | 00:04 |
| rook | bnemec: i think it might b e | 00:06 |
| rook | be the yaql setting | 00:06 |
| * rook tries | 00:06 | |
| rook | just reading through things | 00:07 |
| *** salmankhan has quit IRC | 00:10 | |
| *** salmankhan has joined #tripleo | 00:10 | |
| *** pmannidi has quit IRC | 00:11 | |
| *** pmannidi has joined #tripleo | 00:11 | |
| *** funzo has joined #tripleo | 00:22 | |
| *** salmankhan has quit IRC | 00:24 | |
| *** funzo has quit IRC | 00:26 | |
| *** gfidente|afk has quit IRC | 00:43 | |
| openstackgerrit | Steve Baker proposed openstack/python-tripleoclient master: New command "overcloud container image upload" https://review.openstack.org/446250 | 00:46 |
| *** deadnull has quit IRC | 00:52 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-quickstart-extras master: Use upload command to upload container images https://review.openstack.org/446252 | 00:54 |
| *** rhallisey has quit IRC | 00:55 | |
| *** limao has joined #tripleo | 00:57 | |
| *** thrash is now known as thrash|g0ne | 01:01 | |
| *** lblanchard has joined #tripleo | 01:03 | |
| *** toure is now known as toure|gone | 01:12 | |
| *** funzo has joined #tripleo | 01:23 | |
| *** funzo has quit IRC | 01:27 | |
| *** dmacpher has joined #tripleo | 01:34 | |
| *** liverpooler has quit IRC | 01:35 | |
| openstackgerrit | Steve Baker proposed openstack/tripleo-common master: WIP modify the overcloud_containers.yaml https://review.openstack.org/446266 | 01:42 |
| *** bfournie has joined #tripleo | 01:44 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: TEST: DONT RECHECK or REVIEW: periodic jobs https://review.openstack.org/359215 | 01:45 |
| *** oaken_chris has joined #tripleo | 01:54 | |
| *** lblanchard has quit IRC | 02:12 | |
| *** fragatin_ has joined #tripleo | 02:13 | |
| *** marst has joined #tripleo | 02:14 | |
| *** fragatina has quit IRC | 02:16 | |
| *** yamahata has quit IRC | 02:16 | |
| *** fragatin_ has quit IRC | 02:17 | |
| *** kjw3 has quit IRC | 02:18 | |
| *** eck`gone is now known as eck` | 02:20 | |
| *** funzo has joined #tripleo | 02:23 | |
| *** fragatina has joined #tripleo | 02:26 | |
| *** cwolferh has joined #tripleo | 02:27 | |
| *** funzo has quit IRC | 02:28 | |
| *** fragatina has quit IRC | 02:30 | |
| *** japestinho has joined #tripleo | 02:54 | |
| *** rlandy has quit IRC | 03:00 | |
| *** fragatina has joined #tripleo | 03:00 | |
| *** fragatina has quit IRC | 03:01 | |
| *** fragatina has joined #tripleo | 03:02 | |
| jidar | I had that error and updated the value, restarted heat, re-ran the stack and fixed it | 03:13 |
| jidar | this was on a kilo version of osp, befoer the default for an undercloud was changed to 10k iirc | 03:14 |
| *** gbarros has quit IRC | 03:15 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Don't provide dib-run-parts https://review.openstack.org/446285 | 03:19 |
| openstackgerrit | David Costakos proposed openstack/tripleo-validations master: OverCloud Ceilomter Events Sane Defaults. Add Validation to see if the overcloud is appropriately configured for most deployments. https://review.openstack.org/446287 | 03:22 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Don't provide dib-run-parts https://review.openstack.org/446285 | 03:24 |
| *** funzo has joined #tripleo | 03:24 | |
| *** leifmadsen has quit IRC | 03:26 | |
| *** leifmadsen has joined #tripleo | 03:27 | |
| *** funzo has quit IRC | 03:28 | |
| openstackgerrit | Ghanshyam Mann proposed openstack/tripleo-quickstart-extras master: Fix to use correct config options for ssh user https://review.openstack.org/446289 | 03:29 |
| *** psahoo has joined #tripleo | 03:43 | |
| *** udesale has joined #tripleo | 03:48 | |
| *** oaken_chris has quit IRC | 03:50 | |
| *** oaken_chris has joined #tripleo | 03:58 | |
| *** oaken_chris has quit IRC | 04:10 | |
| *** links has joined #tripleo | 04:10 | |
| *** d0ugal has quit IRC | 04:13 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Do not disable other repos when updating gate packages https://review.openstack.org/446129 | 04:14 |
| *** psahoo has quit IRC | 04:15 | |
| *** psahoo has joined #tripleo | 04:15 | |
| openstackgerrit | Merged openstack/python-tripleoclient master: Use a Zaqar queue to get stack events https://review.openstack.org/394420 | 04:17 |
| *** funzo has joined #tripleo | 04:25 | |
| *** funzo has quit IRC | 04:29 | |
| *** d0ugal has joined #tripleo | 04:31 | |
| *** skramaja has joined #tripleo | 04:35 | |
| *** tzumainn has quit IRC | 04:37 | |
| *** fragatina has quit IRC | 04:42 | |
| *** ratailor has joined #tripleo | 05:04 | |
| *** ratailor has quit IRC | 05:07 | |
| *** jaganathan has joined #tripleo | 05:10 | |
| *** nyechiel has joined #tripleo | 05:13 | |
| *** brault_ has joined #tripleo | 05:15 | |
| *** ratailor has joined #tripleo | 05:15 | |
| *** jaganathan has quit IRC | 05:16 | |
| *** brault has quit IRC | 05:17 | |
| *** funzo has joined #tripleo | 05:26 | |
| *** nyechiel has quit IRC | 05:26 | |
| *** dsariel has quit IRC | 05:29 | |
| *** funzo has quit IRC | 05:30 | |
| *** udesale has quit IRC | 05:32 | |
| *** udesale has joined #tripleo | 05:32 | |
| *** saneax-_-|AFK is now known as saneax | 05:34 | |
| *** psahoo has quit IRC | 05:35 | |
| *** psahoo has joined #tripleo | 05:35 | |
| *** gkadam has joined #tripleo | 05:37 | |
| *** bkopilov has quit IRC | 05:44 | |
| *** yprokule has joined #tripleo | 05:54 | |
| *** psahoo has quit IRC | 05:58 | |
| *** psahoo has joined #tripleo | 05:59 | |
| *** bkopilov has joined #tripleo | 06:00 | |
| *** psahoo has quit IRC | 06:00 | |
| *** psahoo has joined #tripleo | 06:01 | |
| *** psahoo has quit IRC | 06:04 | |
| *** psahoo has joined #tripleo | 06:04 | |
| *** egafford has joined #tripleo | 06:08 | |
| *** psahoo has quit IRC | 06:10 | |
| *** jaganathan has joined #tripleo | 06:14 | |
| *** psahoo has joined #tripleo | 06:14 | |
| *** psahoo has joined #tripleo | 06:15 | |
| *** masco has joined #tripleo | 06:18 | |
| *** fzdarsky has joined #tripleo | 06:19 | |
| *** skramaja_ has joined #tripleo | 06:19 | |
| *** skramaja_ has quit IRC | 06:19 | |
| *** psahoo has joined #tripleo | 06:20 | |
| *** skramaja has quit IRC | 06:22 | |
| *** karthiks_afk is now known as karthiks | 06:24 | |
| *** funzo has joined #tripleo | 06:26 | |
| *** florianf has joined #tripleo | 06:27 | |
| *** funzo has quit IRC | 06:31 | |
| *** gchamoul is now known as gchamoul|afk | 06:35 | |
| *** lmiccini has joined #tripleo | 06:37 | |
| openstackgerrit | Martin André proposed openstack-infra/tripleo-ci master: Collect more info about docker https://review.openstack.org/441050 | 06:47 |
| *** jtomasek has joined #tripleo | 06:51 | |
| *** prateek has joined #tripleo | 06:56 | |
| *** lmiccini has quit IRC | 06:59 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-specs master: Deployment plan management changes https://review.openstack.org/438918 | 07:02 |
| openstackgerrit | Michele Baldessari proposed openstack-infra/tripleo-ci master: Make sure we upgrade to the right repos during an upgrade https://review.openstack.org/446121 | 07:11 |
| *** abehl has joined #tripleo | 07:11 | |
| *** lmiccini has joined #tripleo | 07:13 | |
| *** dparkes has joined #tripleo | 07:15 | |
| *** ealcaniz has joined #tripleo | 07:17 | |
| *** gkadam has quit IRC | 07:23 | |
| *** gkadam has joined #tripleo | 07:26 | |
| *** jaosorior has joined #tripleo | 07:26 | |
| *** ealcaniz has quit IRC | 07:27 | |
| *** funzo has joined #tripleo | 07:27 | |
| *** ealcaniz has joined #tripleo | 07:28 | |
| *** pmannidi has quit IRC | 07:29 | |
| *** florianf has quit IRC | 07:30 | |
| *** yamahata has joined #tripleo | 07:30 | |
| *** funzo has quit IRC | 07:32 | |
| *** tesseract has joined #tripleo | 07:33 | |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder master: Refactor: block-device filesystem creation, mount and fstab https://review.openstack.org/444586 | 07:33 |
| *** psahoo has quit IRC | 07:33 | |
| *** dmacpher has quit IRC | 07:34 | |
| *** udesale has quit IRC | 07:40 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Add lookup plugin for tripleo heat templates https://review.openstack.org/441164 | 07:41 |
| *** jlinkes has joined #tripleo | 07:41 | |
| *** florianf has joined #tripleo | 07:44 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Port the network environment validation https://review.openstack.org/341586 | 07:46 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates stable/ocata: Upgrades: wait for galera to be settled https://review.openstack.org/444928 | 07:47 |
| openstackgerrit | Adriano Petrich proposed openstack/tripleo-common master: add caching the GetParametersAction https://review.openstack.org/444220 | 07:50 |
| *** mcornea has joined #tripleo | 07:53 | |
| openstackgerrit | Martin André proposed openstack-infra/tripleo-ci master: Collect more info about docker https://review.openstack.org/441050 | 07:59 |
| *** zzzeek has quit IRC | 08:00 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK https://review.openstack.org/430277 | 08:00 |
| *** zzzeek has joined #tripleo | 08:00 | |
| *** aufi has joined #tripleo | 08:02 | |
| *** saibarspeis has joined #tripleo | 08:03 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Update the introspect manageable wrapper to use the multiple message interface https://review.openstack.org/446065 | 08:03 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Update the provide workflow wrapper to use the multiple message interface https://review.openstack.org/446049 | 08:03 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Update the introspect workflow wrapper to use the multiple message interface https://review.openstack.org/446054 | 08:03 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Update the register_or_update wrapper to use the multiple message interface https://review.openstack.org/443053 | 08:03 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Respond to multiple messages from workflow executions https://review.openstack.org/406178 | 08:03 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Update the provide_manageable_nodes wrapper to use the multiple message interface https://review.openstack.org/446081 | 08:04 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Update the configure workflow wrapper to use the multiple message interface https://review.openstack.org/446337 | 08:04 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Update the configure_manageable_nodes wrapper to use multi-message interface https://review.openstack.org/446338 | 08:04 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Update the create_raid_configuration wrapper to use multiple message interface https://review.openstack.org/446339 | 08:04 |
| * d0ugal ducks | 08:04 | |
| *** flepied has quit IRC | 08:04 | |
| bandini | ehehe | 08:05 |
| *** saibarspeis has quit IRC | 08:06 | |
| *** shardy has joined #tripleo | 08:09 | |
| *** bogdando has joined #tripleo | 08:11 | |
| *** jtomasek has quit IRC | 08:16 | |
| *** jtomasek_ has joined #tripleo | 08:16 | |
| openstackgerrit | Adriano Petrich proposed openstack/tripleo-common master: add caching the GetParametersAction https://review.openstack.org/444220 | 08:17 |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: WIP: Add lvm management to diskimage-builder https://review.openstack.org/444403 | 08:18 |
| *** ccamacho has joined #tripleo | 08:20 | |
| *** yprokule_ has joined #tripleo | 08:20 | |
| *** yprokule has quit IRC | 08:23 | |
| *** yprokule_ is now known as yprokule | 08:23 | |
| jaosorior | bandini: saw you had a WIP commit about getting rabbitmq behind haproxy, how's that going? | 08:23 |
| bandini | jaosorior: oh I need to dust that off, I haven't toyed with that in ages | 08:24 |
| jaosorior | is that still a plan? | 08:24 |
| *** yamahata has quit IRC | 08:25 | |
| jaosorior | bandini: and how would that work? would rabbitmq be bound to a VIP? | 08:25 |
| *** saibarspeis has joined #tripleo | 08:25 | |
| bandini | well it is kind of low on my todo list. | 08:26 |
| bandini | jaosorior: yeah just like the other services | 08:26 |
| jaosorior | bandini: please let me know how that goes. Cause for that I will probably need to change how I request certs for rabbitmq | 08:26 |
| jaosorior | and that'll probably (initially) break the TLS-everywhere gate | 08:27 |
| bandini | jaosorior: oh, thanks for the heads up | 08:27 |
| bandini | yeah I think I would need to also figure out upgrades as well | 08:27 |
| jaosorior | sshnaidm: hey dude, can you help me figure out why this gate failed https://review.openstack.org/#/c/444885/ ? still having a rough time with the log format | 08:27 |
| *** funzo has joined #tripleo | 08:28 | |
| *** skramaja has joined #tripleo | 08:28 | |
| *** pcaruana has joined #tripleo | 08:30 | |
| remix_tj | Hello, since in master some upgrade script has been cleaned up, does i need to abandon https://review.openstack.org/#/c/439749/ and submit for review in stable/newton ? | 08:30 |
| jaosorior | remix_tj: that or for stable/ocata, depending on what applies for your case | 08:31 |
| remix_tj | jaosorior: it's a fix for major upgrade that i used in m->n upgrade, don't know if for ocata is still applicable | 08:32 |
| *** funzo has quit IRC | 08:32 | |
| jaosorior | rmcadams: ok, then for stable/newton should be fine | 08:33 |
| jaosorior | remix_tj: just make sure that there is a launchpad bug open | 08:33 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE: Testing certmonger user profile https://review.openstack.org/446348 | 08:33 |
| remix_tj | jaosorior: yes, it is. It's an improved fix for the same bug. Had another review on the same topic. | 08:34 |
| jaosorior | cool cool | 08:34 |
| sshnaidm | jaosorior, hi | 08:35 |
| sshnaidm | jaosorior, http://logs.openstack.org/85/444885/2/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/706a2f2/console.html#_2017-03-16_06_41_17_533663 | 08:35 |
| jaosorior | sshnaidm: grepping for "error" or "fail" was not very useful | 08:35 |
| sshnaidm | jaosorior, undercloud failed to install, and most of logs are now in undercloud/home/jenkins: http://logs.openstack.org/85/444885/2/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/706a2f2/logs/undercloud/home/jenkins/undercloud_install.log.txt.gz | 08:35 |
| sshnaidm | jaosorior, it's usually last task in ansible run | 08:35 |
| jaosorior | sshnaidm: any tips? | 08:35 |
| jaosorior | right | 08:36 |
| sshnaidm | jaosorior, we don't continue to run if task fails | 08:36 |
| *** saibarspeis has quit IRC | 08:36 | |
| jaosorior | sshnaidm: ok | 08:36 |
| *** jpich has joined #tripleo | 08:36 | |
| sshnaidm | jaosorior, http://logs.openstack.org/85/444885/2/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/706a2f2/logs/undercloud/home/jenkins/undercloud_install.log.txt.gz#_2017-03-16_06_41_07_342 | 08:36 |
| sshnaidm | jaosorior, I saw this before, it may be regression.. | 08:36 |
| jaosorior | sshnaidm: this seems more like the issue http://logs.openstack.org/85/444885/2/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/706a2f2/logs/undercloud/home/jenkins/undercloud_install.log.txt.gz#_2017-03-16_06_31_40_838 | 08:37 |
| *** skramaja_ has joined #tripleo | 08:37 | |
| sshnaidm | jaosorior, right | 08:37 |
| d0ugal | jpich: if you would have time to look at this patch series I'd apreciate it! https://review.openstack.org/#/c/406178/ | 08:37 |
| jaosorior | sshnaidm: puppet does keep running after some errors. So you want to grep for "Error:" | 08:37 |
| jaosorior | sshnaidm: seems like a mirror error? or an issue in rdo | 08:37 |
| *** cylopez has joined #tripleo | 08:37 | |
| *** skramaja has quit IRC | 08:38 | |
| sshnaidm | jaosorior, it's better ask #rdo, but I think you can just recheck.. | 08:38 |
| sshnaidm | jaosorior, we have some problems with mirrors these days related to release I think, but I don't know all the details | 08:38 |
| *** flepied has joined #tripleo | 08:41 | |
| jpich | d0ugal: Ooh it's ready for review is it, cool! Noted :) | 08:41 |
| d0ugal | jpich: yeah, there is a few related changed too you'll see - I am adding more still. | 08:42 |
| jpich | d0ugal: A few yeah :P | 08:42 |
| *** jpena|off is now known as jpena | 08:44 | |
| jaosorior | d0ugal: hey dude, can you check this out https://review.openstack.org/#/c/446071/1 | 08:46 |
| *** psahoo has joined #tripleo | 08:50 | |
| *** cylopez has quit IRC | 08:50 | |
| *** dsariel has joined #tripleo | 08:51 | |
| *** amoralej|off is now known as amoralej | 08:52 | |
| *** ealcaniz has quit IRC | 08:53 | |
| *** deadnull has joined #tripleo | 08:55 | |
| d0ugal | jaosorior: sure | 08:55 |
| d0ugal | jaosorior: LGTM | 08:56 |
| *** athomas has joined #tripleo | 08:56 | |
| *** jpena is now known as jpena|off | 08:57 | |
| openstackgerrit | Martin André proposed openstack-infra/tripleo-ci master: Collect more info about docker https://review.openstack.org/441050 | 08:57 |
| jaosorior | d0ugal: thanks | 08:58 |
| *** lucas-pto is now known as lucasagomes | 08:58 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add spec tests for tripleo::certmonger::mysql class https://review.openstack.org/446368 | 09:02 |
| *** skramaja_ is now known as skramaja | 09:03 | |
| *** jpena|off is now known as jpena | 09:04 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add spec tests for tripleo::certmonger::mysql class https://review.openstack.org/446368 | 09:04 |
| *** shadower has joined #tripleo | 09:04 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add spec test for tripleo::certmonger::httpd resource https://review.openstack.org/446371 | 09:07 |
| *** yprokule has quit IRC | 09:09 | |
| *** yprokule has joined #tripleo | 09:09 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add spec test for tripleo::certmonger::httpd resource https://review.openstack.org/446371 | 09:10 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add spec tests for tripleo::certmonger::mysql class https://review.openstack.org/446368 | 09:10 |
| *** jbadiapa_ has quit IRC | 09:11 | |
| *** snecklifter has quit IRC | 09:11 | |
| ccamacho | hey mwhahaha morning! related to the puppet-lint upgrade, mmm there are a bunch of items in the changelog from 2.0.1 to 2.1.1, so, what do think will be better related to the version pin? I believe as is not critical to have it updated, we can have the pin, and once per cycle upgrade it. | 09:11 |
| *** ealcaniz has joined #tripleo | 09:12 | |
| *** skramaja has quit IRC | 09:13 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-ui stable/ocata: Imported Translations from Zanata https://review.openstack.org/446373 | 09:13 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Populate logs exclude list with infra requirements https://review.openstack.org/446374 | 09:13 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add spec tests for tripleo::certmonger::ca::local class https://review.openstack.org/446375 | 09:13 |
| *** snecklifter_ has quit IRC | 09:14 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Populate logs exclude list with infra requirements https://review.openstack.org/446374 | 09:14 |
| sshnaidm | panda|Zz, created a patch to exclude as infra asks ^^ | 09:14 |
| *** skramaja has joined #tripleo | 09:16 | |
| d0ugal | apetrich: okay, so, you know how workflows send messages over zaqar to the cli and GUI | 09:16 |
| *** number80 has quit IRC | 09:16 | |
| apetrich | d0ugal, aye | 09:17 |
| apetrich | I think | 09:17 |
| d0ugal | apetrich: let me find an example... | 09:17 |
| d0ugal | apetrich: https://github.com/openstack/tripleo-common/blob/master/workbooks/stack.yaml#L92 | 09:17 |
| *** sshnaidm is now known as sshnaidm|bbl | 09:17 | |
| apetrich | d0ugal, cool | 09:18 |
| d0ugal | apetrich: so at the end of that workflow it posts a message to zaqar with the status and any resulting data the client would want. In this case it seems to just be a SUCCESS or FAIL - no other data. | 09:18 |
| d0ugal | apetrich: at the moment the CLI assumes that only one message will be sent from a workflow, and stops listening after it recieves that | 09:18 |
| d0ugal | apetrich: the changes I am making allow workflows to send more, so a long-running workflow could send progress reports | 09:18 |
| apetrich | d0ugal, what I'm not getting is when it stops waiting for messages? | 09:19 |
| d0ugal | apetrich: right! | 09:19 |
| d0ugal | apetrich: so at the moment it stops when it recieves one message. | 09:19 |
| d0ugal | apetrich: https://review.openstack.org/#/c/406178/24/tripleoclient/workflows/base.py | 09:20 |
| d0ugal | apetrich: Line 86-91 | 09:20 |
| jaosorior | jistr, mandre: in the docker/keystone.yaml template, I see there is a volumes section under the keystone_db_sync key: https://github.com/openstack/tripleo-heat-templates/blob/master/docker/services/keystone.yaml#L141-L147 what are those used for? | 09:20 |
| d0ugal | apetrich: it will now stop when it recieves a message that is either SUCCESS / FAIL (or anything that isn't no status or "RUNNING") | 09:20 |
| apetrich | d0ugal, oh ok. that was the part that I was not getting | 09:21 |
| apetrich | d0ugal, but have I not seen your tests sending 2 success messages? | 09:21 |
| d0ugal | apetrich: eventually I would like to require all messages have a status of RUNNING, SUCCESS or FAILED. So after this initial work I can make it stricter (I need to check all the workflow messages first) | 09:21 |
| d0ugal | apetrich: yup, some tests actually trigger two workflow calls - that bit is quite confusing. The tests could probably be improved. | 09:22 |
| apetrich | d0ugal, like here https://review.openstack.org/#/c/446337/1/tripleoclient/tests/v1/baremetal/test_baremetal.py | 09:22 |
| apetrich | d0ugal, ah ok * 2 | 09:22 |
| d0ugal | apetrich: I'll have a think and see if I can make it more obvious, or maybe add a comment to explain it | 09:23 |
| *** yprokule_ has joined #tripleo | 09:23 | |
| apetrich | d0ugal, I wasn't getting how can it got a success msg and wait longer for another. | 09:23 |
| apetrich | *get | 09:23 |
| d0ugal | apetrich: because these changes are so wide reaching I have been trying to change as little as possible - maybe not the right call in this case. | 09:23 |
| apetrich | d0ugal, that makes far more sense to me now | 09:24 |
| *** karimb has joined #tripleo | 09:24 | |
| d0ugal | apetrich: yeah, so it means that iter is being called twice - the previous tests actually masked that the one message was used multiple times. | 09:24 |
| *** skramaja_ has joined #tripleo | 09:24 | |
| d0ugal | so in some ways this is better, but it could be clearer | 09:24 |
| *** limao has quit IRC | 09:25 | |
| *** skramaja has quit IRC | 09:25 | |
| *** cylopez has joined #tripleo | 09:25 | |
| *** yprokule has quit IRC | 09:26 | |
| *** yprokule_ is now known as yprokule | 09:26 | |
| *** links has quit IRC | 09:27 | |
| *** zoli|gone is now known as zoli | 09:28 | |
| apetrich | d0ugal, thanks that cleared a lot | 09:28 |
| d0ugal | apetrich: np! | 09:28 |
| *** skramaja_ has quit IRC | 09:28 | |
| *** funzo has joined #tripleo | 09:29 | |
| *** skramaja_ has joined #tripleo | 09:31 | |
| openstackgerrit | Merged openstack/puppet-tripleo master: Create profile to request certificates for the services in the node https://review.openstack.org/444873 | 09:32 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates master: Explicitly configure credentials used by ironic to access other services https://review.openstack.org/446074 | 09:32 |
| *** jaosorior is now known as jaosorior_lunch | 09:32 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates master: DO NOT MERGE: testing ironic https://review.openstack.org/428053 | 09:33 |
| *** funzo has quit IRC | 09:33 | |
| *** derekh has joined #tripleo | 09:38 | |
| *** skramaja has joined #tripleo | 09:42 | |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-puppet-elements master: Enabled "tuned-profiles-cpu-partitioning" package for overcloud image https://review.openstack.org/418348 | 09:42 |
| skramaja | saneax: ^ | 09:42 |
| *** salmankhan has joined #tripleo | 09:42 | |
| *** skramaja_ has quit IRC | 09:43 | |
| *** gchamoul|afk is now known as gchamoul | 09:43 | |
| *** links has joined #tripleo | 09:44 | |
| saneax | skramaja, acked | 09:45 |
| *** salmankhan has quit IRC | 09:48 | |
| *** nyechiel has joined #tripleo | 09:53 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-docs master: Add Ansible tasks to container service yaml structure https://review.openstack.org/446046 | 09:55 |
| *** suuuper has joined #tripleo | 09:57 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Add new role for tripleo-validations https://review.openstack.org/403576 | 09:58 |
| *** dbecker has joined #tripleo | 09:58 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart master: Add ability to run tripleo-validations tests https://review.openstack.org/403731 | 09:58 |
| *** saibarspeis has joined #tripleo | 10:01 | |
| *** ealcaniz has quit IRC | 10:02 | |
| *** ealcaniz has joined #tripleo | 10:02 | |
| *** jbadiapa has joined #tripleo | 10:03 | |
| *** tosky has joined #tripleo | 10:10 | |
| d0ugal | Sorry in advance :) | 10:11 |
| *** deadnull has quit IRC | 10:13 | |
| rook | shardy: hey ran into this last night, tried tuning something however it seems to always be failing now? https://gist.github.com/jtaleric/f970a2e89d944915d8543429950423c6#limit-on-hostname-elements | 10:16 |
| rook | it being the deployment | 10:16 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Don't rely on umask to set appropriate permissions on overcloudrc* https://review.openstack.org/446071 | 10:17 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: WIP: add timestamp to logs https://review.openstack.org/446075 | 10:17 |
| shardy | rook: ah, yeah we already increased that limit, but perhaps not enough for your usage | 10:19 |
| shardy | rook: did you restart heat-engine after making the change to the limit? | 10:19 |
| rook | yup | 10:19 |
| rook | I don't see that error anymore shardy but I am just bumping into the timeout (240) | 10:19 |
| rook | which things were taking < 100 thus far, so that is why I assumed something else is wrong | 10:20 |
| shardy | Oh I thought you were linking the error from the failure | 10:20 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from introspect manageable https://review.openstack.org/446065 | 10:20 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from provide workflow https://review.openstack.org/446049 | 10:20 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from introspect workflow https://review.openstack.org/446054 | 10:20 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from get_passwords https://review.openstack.org/443053 | 10:20 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Handle multiple messages from workflow executions https://review.openstack.org/406178 | 10:20 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from configure workflow https://review.openstack.org/446337 | 10:20 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from create_raid_configuration https://review.openstack.org/446339 | 10:20 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from provide_manageable_nodes https://review.openstack.org/446081 | 10:20 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from configure_manageable_nodes https://review.openstack.org/446338 | 10:20 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from register_or_update https://review.openstack.org/446432 | 10:20 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from create_default_plan https://review.openstack.org/446433 | 10:20 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from create/update_deployment_plan https://review.openstack.org/446434 | 10:20 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from package_update https://review.openstack.org/446435 | 10:20 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from delete_stack https://review.openstack.org/446436 | 10:20 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from deploy_plan https://review.openstack.org/446437 | 10:20 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from delete_node https://review.openstack.org/446438 | 10:20 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Remove the single-message interface to websockets https://review.openstack.org/446439 | 10:20 |
| rook | ah, no shardy i didn't know if i tuned the right thing (the 1000 element issue), sounds like I did. | 10:21 |
| rook | shardy the issue now is that I keep hitting the timeout. | 10:21 |
| shardy | rook: ah, yeah that was the right fix for the error referenced | 10:21 |
| *** oaken_chris has joined #tripleo | 10:22 | |
| rook | ok, is 10k too much? | 10:22 |
| rook | should i have stepped it slower, didn't know if going too big would cause other issues | 10:22 |
| shardy | rook: No the limit is there primarily to prevent DoS attacks in real cloud usage, as yaql queries can eat a lot of memory | 10:23 |
| shardy | rook: other than enabling more heat memory usage I think it should be safe | 10:23 |
| *** akrivoka has joined #tripleo | 10:24 | |
| rook | shardy: ack | 10:26 |
| rook | thanks | 10:26 |
| rook | so something else is causing things to lock up | 10:26 |
| rook | ugh | 10:27 |
| *** funzo has joined #tripleo | 10:29 | |
| *** dsariel_ has joined #tripleo | 10:31 | |
| *** dsariel has quit IRC | 10:32 | |
| *** funzo has quit IRC | 10:34 | |
| *** ckyriakidou has joined #tripleo | 10:36 | |
| *** oaken_chris has quit IRC | 10:37 | |
| openstackgerrit | Martin André proposed openstack-infra/tripleo-ci master: Collect more info about docker https://review.openstack.org/441050 | 10:37 |
| *** jkilpatr has quit IRC | 10:38 | |
| *** saibarspeis has quit IRC | 10:42 | |
| *** jaosorior_lunch is now known as jaosorior | 10:51 | |
| *** zoli is now known as zoli|lunch | 10:55 | |
| *** skramaja has quit IRC | 11:01 | |
| -openstackstatus- NOTICE: paste.openstack.org is down, due to connectivity issues with backend database. support ticket has been created. | 11:02 | |
| *** ChanServ changes topic to "paste.openstack.org is down, due to connectivity issues with backend database. support ticket has been created." | 11:02 | |
| bandini | panda|Zz, sshnaidm|bbl: seen this ci mitaka issue: https://bugs.launchpad.net/tripleo/+bug/1673424 ? | 11:05 |
| openstack | Launchpad bug 1673424 in tripleo "Mitaka - CI fails with --env errors" [Critical,Triaged] | 11:05 |
| *** jkilpatr has joined #tripleo | 11:05 | |
| *** dtantsur|afk is now known as dtantsur | 11:08 | |
| *** dtantsur is now known as dtantsur|sick | 11:09 | |
| panda|Zz | bandini: ah, looking, thanks. | 11:09 |
| panda|Zz | (I'm not really Zz) | 11:10 |
| bandini | ehehe thanks ;) | 11:10 |
| jaosorior | shardy: in what jobs do we do an image build? | 11:18 |
| mandre | sshnaidm|bbl: do you have an idea why log collection doesn't work with https://review.openstack.org/#/c/441050/? How can I debug it? | 11:18 |
| *** ansmith has quit IRC | 11:20 | |
| openstackgerrit | Julie Pichon proposed openstack/python-tripleoclient master: Fix return code when failing before launching the stack https://review.openstack.org/446470 | 11:21 |
| *** saibarspeis has joined #tripleo | 11:22 | |
| panda|Zz | mandre: which job, gate-tripleo-ci-centos-7-undercloud-containers ? | 11:23 |
| shardy | jaosorior: the ovb jobs when tripleo-ci/scripts/common_functions.sh canusecache evaluates to true | 11:23 |
| *** deadnull has joined #tripleo | 11:24 | |
| bandini | panda|Zz: do you have a link for the last successfull mitaka job? | 11:26 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: docker-puppet: skip empty volume entries https://review.openstack.org/446472 | 11:27 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: docker/keystone: Bind mount entire fernet keys repository https://review.openstack.org/446473 | 11:27 |
| *** cylopez has quit IRC | 11:27 | |
| panda|Zz | bandini: I have a link for the last successful periodic HA job | 11:28 |
| bandini | panda|Zz: that might help too | 11:28 |
| panda|Zz | bandini: http://logs.openstack.org/periodic/periodic-tripleo-ci-centos-7-ovb-ha-mitaka/7d0705d/console.html | 11:28 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Remove spurious endpoint_map entry https://review.openstack.org/445890 | 11:29 |
| *** thrash|g0ne is now known as thrash | 11:29 | |
| *** zoli|lunch is now known as zoli | 11:29 | |
| mhenkel | shardy: looking into https://review.openstack.org/#/c/445890/ | 11:29 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Remove certificate request bits from service profiles https://review.openstack.org/444891 | 11:29 |
| shardy | mhenkel: hi! Thanks, I've become slightly confused | 11:30 |
| *** gkadam has quit IRC | 11:30 | |
| shardy | mhenkel: as there are several other hiera keys which don't appear to align with https://github.com/Juniper/puppet-contrail/ | 11:30 |
| *** funzo has joined #tripleo | 11:30 | |
| shardy | mhenkel: perhaps I'm missing something :) | 11:30 |
| jaosorior | shardy: thanks | 11:31 |
| *** pblaho has quit IRC | 11:31 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Add upgrade tasks for aodh containers https://review.openstack.org/445600 | 11:32 |
| panda|Zz | bandini: I think the culprit is dib2 | 11:32 |
| *** athomas has quit IRC | 11:32 | |
| *** athomas has joined #tripleo | 11:33 | |
| bandini | panda|Zz: it is the change to instack for dib2, yes | 11:33 |
| * shardy wonders if that caused https://bugs.launchpad.net/tripleo/+bug/1673144 too | 11:33 | |
| openstack | Launchpad bug 1673144 in tripleo "lots of empty /tmp/profiledir directories not cleaned up" [High,Triaged] | 11:33 |
| *** funzo has quit IRC | 11:35 | |
| *** rhallisey has joined #tripleo | 11:37 | |
| openstackgerrit | Merged openstack/tripleo-docs master: Add Ansible tasks to container service yaml structure https://review.openstack.org/446046 | 11:40 |
| bandini | panda|Zz: I have added just know why we break. no idea how to fix it though | 11:41 |
| *** snecklifter has joined #tripleo | 11:44 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from get_passwords https://review.openstack.org/443053 | 11:46 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from package_update https://review.openstack.org/446435 | 11:46 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from create/update_deployment_plan https://review.openstack.org/446434 | 11:46 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Remove the single-message interface to websockets https://review.openstack.org/446439 | 11:46 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from delete_node https://review.openstack.org/446438 | 11:46 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from deploy_plan https://review.openstack.org/446437 | 11:46 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient master: Support multiple messages from delete_stack https://review.openstack.org/446436 | 11:46 |
| *** jaganathan has quit IRC | 11:48 | |
| *** pblaho has joined #tripleo | 11:48 | |
| *** ChanServ changes topic to "TripleO : http://tripleo.org/ | https://wiki.openstack.org/wiki/TripleO | Meetings On Tuesdays at 14:00 UTC in #openstack-meeting-alt" | 11:49 | |
| -openstackstatus- NOTICE: paste.openstack.org service is back up - turns out it was a networking issue, not a database issue. yay networks! | 11:49 | |
| *** dsariel_ has quit IRC | 11:53 | |
| *** pblaho has quit IRC | 11:53 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: Add timestamps to quickstart logs https://review.openstack.org/446075 | 11:54 |
| mhenkel | shardy: did you check against master branch? | 11:56 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Implement verify profiles as a custom action https://review.openstack.org/429684 | 11:56 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Implement check ironic boot configuration as a custom action https://review.openstack.org/428225 | 11:56 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Implement check flavors as a custom action https://review.openstack.org/428178 | 11:57 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Implement check node counts as a custom action https://review.openstack.org/429757 | 11:57 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add workflow wrapping all predeployment validations https://review.openstack.org/445914 | 11:57 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Implement check boot images as a custom action https://review.openstack.org/428177 | 11:57 |
| *** dprince has joined #tripleo | 11:57 | |
| *** pradk has joined #tripleo | 11:57 | |
| shardy | mhenkel: I just cloned it and grepped the master branch, did I miss something? | 11:58 |
| bandini | slagle: help? https://bugs.launchpad.net/tripleo/+bug/1673424 ;) | 11:59 |
| openstack | Launchpad bug 1673424 in tripleo "Mitaka - CI fails with --env errors" [Critical,Triaged] | 11:59 |
| mhenkel | shardy: I need to checkin some changes to master | 11:59 |
| mhenkel | will let you know | 11:59 |
| bandini | slagle: seems the dib2 stuff in instack ended up in mitaka repos as well | 11:59 |
| shardy | mhenkel: ack, thanks for looking into it! | 11:59 |
| *** pradk has quit IRC | 12:03 | |
| *** jkilpatr has quit IRC | 12:04 | |
| *** skramaja has joined #tripleo | 12:05 | |
| *** pblaho has joined #tripleo | 12:07 | |
| *** rbowen has joined #tripleo | 12:09 | |
| *** amoralej is now known as amoralej|lunch | 12:10 | |
| *** fultonj has joined #tripleo | 12:11 | |
| *** jpena is now known as jpena|lunch | 12:11 | |
| remix_tj | This time i found a bug that i've no skill enough to fix: https://bugs.launchpad.net/tripleo/+bug/1673439 | 12:15 |
| openstack | Launchpad bug 1673439 in tripleo "In Newton, while replacing controller node with ID 0 : StackValidationFailed: resources.AllNodesValidationConfig: Property error: AllNodesValidationConfig.Properties.PingTestIps: The Referenced Attribute (Controller resource.0.external_ip_address) is incorrect." [Undecided,New] | 12:15 |
| remix_tj | i accept suggestions | 12:15 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: docker/keystone: add metadata_settings to output https://review.openstack.org/446483 | 12:16 |
| *** trown|outtypewww is now known as trown | 12:19 | |
| *** abishop has joined #tripleo | 12:19 | |
| *** jkilpatr has joined #tripleo | 12:20 | |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Fix stackviz report generation https://review.openstack.org/444267 | 12:20 |
| openstackgerrit | Merged openstack/tripleo-ui stable/ocata: Imported Translations from Zanata https://review.openstack.org/446373 | 12:21 |
| *** ratailor has quit IRC | 12:21 | |
| openstackgerrit | Merged openstack/tripleo-common master: UpdateCapabilitiesAction add purge_missing option https://review.openstack.org/444226 | 12:21 |
| shardy | remix_tj: it's because of this hard-coded reference to the "0" node here: | 12:22 |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/stable/newton/overcloud.j2.yaml#L506 | 12:22 |
| *** panda|Zz is now known as panda | 12:22 | |
| shardy | remix_tj: in the latest releases we do that differently, to look up the first item in the list, perhaps we can backport that | 12:22 |
| remix_tj | shardy: also ocata has 0 harcoded as far as i can see | 12:23 |
| remix_tj | and also master seems, but i see that there is a function that is retreiving the bootstrapnode | 12:23 |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/overcloud.j2.yaml#L299 | 12:24 |
| shardy | remix_tj: Yeah I think we should be doing it similar to ^^ | 12:24 |
| shardy | it's a mistake that PingTestIps didn't get changed to remove the hard-coded reference | 12:24 |
| remix_tj | yeah, i was referring exactly to that | 12:25 |
| remix_tj | is also available in newton | 12:25 |
| shardy | remix_tj: yeah I think it should be possible to fix on master and backport to ocata/newton - thanks for reporting it | 12:25 |
| shardy | remix_tj: I commented on the bug, are you planning to test & push a patch? | 12:27 |
| remix_tj | i can try, but i've to look deeper at the code because i'm not an heat guru | 12:28 |
| *** karimb has quit IRC | 12:28 | |
| trown | remix_tj: I can help you if you want to try to submit a patch yourself, but if you dont really have the bandwidth to work on that it is ok too | 12:28 |
| d0ugal | rbrady, thrash: https://review.openstack.org/#/c/406178/ if you have time ... and the one or two related changes ;) | 12:29 |
| shardy | yeah, I can push a patch now, but I didn't want to duplicate any effort :) | 12:29 |
| EmilienM | panda, sshnaidm|bbl : how things are going? | 12:29 |
| *** morazi has joined #tripleo | 12:30 | |
| panda | EmilienM: https://bugs.launchpad.net/tripleo/+bug/1673282, some items need to be discussed | 12:31 |
| openstack | Launchpad bug 1673282 in tripleo "quickstart logging: implement compliance with infra requirements" [Critical,Triaged] | 12:31 |
| *** funzo_ has joined #tripleo | 12:31 | |
| panda | for example, I don't know if we aver need the comple lsof, maybe it was useful once | 12:31 |
| *** liverpooler has joined #tripleo | 12:32 | |
| *** athomas has quit IRC | 12:32 | |
| remix_tj | trown: i'll take a look and if i don't have idea on what to do i'll ask you for help. Thanks for your time | 12:32 |
| trown | remix_tj: thanks for contributing :) | 12:33 |
| openstackgerrit | Maroš Zaťko proposed openstack/tripleo-validations master: WIP - Validate Metadata port reachability on undercloud https://review.openstack.org/446495 | 12:33 |
| thrash | d0ugal: ack | 12:33 |
| EmilienM | panda: infra doesn't want to land the project config patch? | 12:33 |
| thrash | d0ugal: seriously? :P | 12:33 |
| EmilienM | panda: I'm going to ask them to merge it | 12:34 |
| d0ugal | thrash: lol, it seemed like the easiest way... but maybe it was a mistake! | 12:34 |
| panda | EmilienM: not explicitly, but I think they certainly want us to reduce the build size, counting also the bytes. | 12:35 |
| thrash | d0ugal: yeah... Uh... Let's ask this question... Would we ever need to revert just *one* of those? | 12:35 |
| panda | EmilienM: I think you can. | 12:35 |
| *** morazi has quit IRC | 12:35 | |
| d0ugal | thrash: possibly. | 12:35 |
| *** funzo_ has quit IRC | 12:35 | |
| thrash | d0ugal: what's your scenario? | 12:35 |
| EmilienM | panda: trying on the infra chan | 12:36 |
| d0ugal | thrash: if one workflow turns out to have an issue with the multiple messages | 12:36 |
| thrash | d0ugal: I guess there's a fine line between granularity and a B.A.P. | 12:36 |
| d0ugal | thrash: so far it has helped me iron out the remaining issues with specific CI failures I had to rebase on somebody elses change - that stuff had just blocked me before because it got so hard each time. | 12:37 |
| d0ugal | thrash: I don't know what B.A.P. means :) | 12:37 |
| thrash | d0ugal: Big Ass Patch. I just made it up. :P | 12:37 |
| d0ugal | haha | 12:37 |
| *** udesale has joined #tripleo | 12:37 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-quickstart-extras master: Allow complex upgrade deployment for N to O https://review.openstack.org/439598 | 12:38 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements https://review.openstack.org/440124 | 12:38 |
| d0ugal | thrash: I also think it should be much easier to review, because otherwise it just looks like a mock mess. | 12:38 |
| *** athomas has joined #tripleo | 12:38 | |
| thrash | d0ugal: I hear ya. | 12:38 |
| d0ugal | thrash: but if it is a pain... I guess I can squash easily | 12:38 |
| jaosorior | EmilienM, mwhahaha can you check these out https://review.openstack.org/#/q/topic:spec-certmonger ? | 12:38 |
| thrash | nah... | 12:38 |
| * d0ugal be like ¯\_(ツ)_/¯ | 12:38 | |
| d0ugal | thrash: there is no rush for any of them anyway, so there is that. | 12:39 |
| thrash | hehe | 12:39 |
| *** rlandy has joined #tripleo | 12:40 | |
| EmilienM | jaosorior: I will | 12:40 |
| EmilienM | jaosorior: wow thanks! | 12:41 |
| jaosorior | EmilienM: saw the patches you did for etcd, nice! | 12:41 |
| EmilienM | jaosorior: well nice but not nice ;-) | 12:42 |
| jaosorior | EmilienM: it's a start. | 12:42 |
| *** gfidente has joined #tripleo | 12:42 | |
| *** gfidente has quit IRC | 12:42 | |
| *** gfidente has joined #tripleo | 12:42 | |
| *** pkovar has joined #tripleo | 12:43 | |
| *** ansmith has joined #tripleo | 12:44 | |
| jaosorior | dprince, mandre, jistr: What do you guys think of this https://review.openstack.org/#/c/446472/ ? | 12:44 |
| *** liverpooler has quit IRC | 12:44 | |
| *** liverpooler has joined #tripleo | 12:44 | |
| *** morazi has joined #tripleo | 12:48 | |
| *** jmelvin has joined #tripleo | 12:48 | |
| dprince | jaosorior: commented | 12:49 |
| jaosorior | dprince: thanks | 12:49 |
| *** shardy is now known as shardy_lunch | 12:50 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: docker/keystone: Bind mount entire fernet keys repository https://review.openstack.org/446473 | 12:50 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: docker-puppet: skip empty volume entries https://review.openstack.org/446472 | 12:50 |
| jaosorior | dprince: fixed. Thanks | 12:52 |
| jistr | dprince: jaosorior: shouldn't we do it on the Heat side rather? | 12:52 |
| EmilienM | trown, panda: it seems like stable/ocata jobs don't work on oooq: http://logs.openstack.org/75/440675/3/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/ff64697/console.html#_2017-03-16_11_29_33_765749 | 12:52 |
| jistr | dprince: jaosorior: with yaql like `$.where($ != '')` | 12:53 |
| *** jkilpatr has quit IRC | 12:53 | |
| dprince | jistr: it doesn't hurt to support it in both places I think | 12:53 |
| jaosorior | jistr: thought doing in docker-puppet would be more lightweight | 12:53 |
| jaosorior | dprince, jistr: this is where I'm trying to use it https://review.openstack.org/#/c/446473/2/docker/services/keystone.yaml | 12:53 |
| EmilienM | trown, panda: I can't find anything helpful in logs, but I probably miss it | 12:53 |
| *** jkilpatr has joined #tripleo | 12:53 | |
| *** lucasagomes is now known as lucas-hungry | 12:54 | |
| panda | EmilienM: it's a delorean error, it's unable to build the package for the gated repo | 12:55 |
| trown | EmilienM: ya looking at http://logs.openstack.org/75/440675/3/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/ff64697/logs/delorean_logs/a7/05/a705d73c742de5e97ee776776d80a4957b1a6321_dev/rpmbuild.log.txt.gz I think it is something broken with packaging rather than some quickstart issue | 12:56 |
| trown | EmilienM: looking into it | 12:56 |
| jistr | dprince: jaosorior: hm right.. My rationale was that for debugging it's nice to keep interfaces clean. Rather than pass through "convenience garbage" and filter it later along the way, it's better to not generate such bogus data at all... But i do see the argument of cleaner code in the templates... | 12:56 |
| *** toure|gone is now known as toure | 12:56 | |
| jistr | so idk i guess i'd be fine either way then | 12:56 |
| dprince | jistr: all good points | 12:56 |
| jaosorior | jistr: and not using that much yaql since it's very memory intensive | 12:56 |
| *** rhallisey has quit IRC | 12:57 | |
| *** rhallisey has joined #tripleo | 12:58 | |
| jaosorior | jistr, dprince: The other option is to change the format to be more similar to what kolla does. having a source and destination, and accepting extra arguments. In this case, that would be the "optional" argument in that terminology | 12:58 |
| jistr | jaosorior, dprince: i'm going to comment and +2. If this bothers us over the long term, we can change it. | 12:59 |
| *** salmankhan has joined #tripleo | 12:59 | |
| *** cdearborn has joined #tripleo | 13:03 | |
| EmilienM | panda: ok infra patch merged, newton jobs should run oooq | 13:03 |
| panda | EmilienM: \o/ | 13:04 |
| *** jpena|lunch is now known as jpena | 13:04 | |
| EmilienM | trown: thanks for looking into it | 13:04 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates stable/ocata: Cleanup no longer used upgrade files https://review.openstack.org/446506 | 13:05 |
| jaosorior | dprince: hey dude, can you help me debug the logs of the undercloud-containers gate? | 13:06 |
| jaosorior | dprince: it failed here http://logs.openstack.org/73/446473/1/experimental/gate-tripleo-ci-centos-7-undercloud-containers/60e37c5/ and I'm not sure if it was because of my commit doing the bind-mount for the fernet keys repo | 13:06 |
| dprince | jaosorior: can we retry after this lands https://review.openstack.org/#/c/446052/ | 13:07 |
| jaosorior | dprince: sure | 13:07 |
| *** Goneri has joined #tripleo | 13:08 | |
| dprince | jaosorior: pretty sure you'd have no chance until that lands fwiw | 13:08 |
| *** Vijayendra has quit IRC | 13:10 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: Add timestamps to quickstart logs https://review.openstack.org/446075 | 13:10 |
| trown | EmilienM: we need to backport https://github.com/openstack/tripleo-common/commit/f642c091293f23ae3fcda4655994fccfdf44b2e6 | 13:11 |
| trown | EmilienM: so it is a legit failure :) | 13:11 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-common stable/ocata: Add pull-puppet-modules script to binaries https://review.openstack.org/446511 | 13:12 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-common stable/ocata: Fix typo in package_update.yaml https://review.openstack.org/440675 | 13:12 |
| *** jbadiapa has quit IRC | 13:12 | |
| EmilienM | trown: nice catch | 13:13 |
| *** cylopez has joined #tripleo | 13:14 | |
| *** masco has quit IRC | 13:14 | |
| *** udesale has quit IRC | 13:14 | |
| *** gbarros has joined #tripleo | 13:15 | |
| openstackgerrit | Merged openstack/tripleo-common master: Generate EtcdInitialClusterToken https://review.openstack.org/446194 | 13:24 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: etcd: secure EtcdInitialClusterToken parameter https://review.openstack.org/446195 | 13:24 |
| *** jcoufal has joined #tripleo | 13:26 | |
| *** tzumainn has joined #tripleo | 13:27 | |
| jaosorior | EmilienM, mwhahaha: Could you check this out https://review.openstack.org/#/c/446083/ ? | 13:28 |
| openstackgerrit | Martin André proposed openstack-infra/tripleo-ci master: Collect more info about docker https://review.openstack.org/441050 | 13:30 |
| *** karimb has joined #tripleo | 13:30 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common stable/ocata: Generate EtcdInitialClusterToken https://review.openstack.org/446516 | 13:30 |
| EmilienM | jaosorior: backport ^ | 13:30 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/ocata: etcd: secure EtcdInitialClusterToken parameter https://review.openstack.org/446517 | 13:31 |
| *** shardy_lunch is now known as shardy | 13:31 | |
| *** fultonj has quit IRC | 13:31 | |
| *** fultonj has joined #tripleo | 13:32 | |
| *** funzo_ has joined #tripleo | 13:32 | |
| *** dparkes has quit IRC | 13:32 | |
| EmilienM | cschwede: do you need https://review.openstack.org/#/c/445998/ in stable/ocata too? | 13:34 |
| *** funzo_ has quit IRC | 13:36 | |
| cschwede | EmilienM: would be nice, but we don't support EC / storage polices / containersync in TripleO out of the box yet, so it is more part of an improvement, not a bugfix per se | 13:37 |
| *** jaosorior has quit IRC | 13:37 | |
| *** jaosorior has joined #tripleo | 13:37 | |
| *** jbadiapa has joined #tripleo | 13:37 | |
| openstackgerrit | Andy Smith proposed openstack/tripleo-heat-templates master: Qpid dispatch router composable role https://review.openstack.org/423326 | 13:37 |
| EmilienM | cschwede: ok so nevermind. | 13:37 |
| *** jaosorior has quit IRC | 13:37 | |
| *** sshnaidm|bbl is now known as sshnaidm | 13:38 | |
| cschwede | EmilienM: there is some manual work required today to use these with tripleo, so starting these services might be simply part of that. | 13:38 |
| openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: overcloud-deploy: unset -e flag in deploy script https://review.openstack.org/446042 | 13:38 |
| cschwede | EmilienM: i just stumbled upon that when testing swift containerization and was thinking to fix that for the future | 13:38 |
| cschwede | EmilienM: that said, thanks for asking about backports! | 13:38 |
| *** jaosorior has joined #tripleo | 13:38 | |
| openstackgerrit | Jiri Stransky proposed openstack/instack-undercloud master: Fix broken command prompt in stackrc https://review.openstack.org/446519 | 13:40 |
| EmilienM | cschwede: anytime | 13:40 |
| *** pradk has joined #tripleo | 13:41 | |
| *** dparkes has joined #tripleo | 13:42 | |
| openstackgerrit | Andy Smith proposed openstack/tripleo-heat-templates master: Qpid dispatch router composable role https://review.openstack.org/423326 | 13:42 |
| *** adarazs is now known as adarazs_brb | 13:43 | |
| fpan | EmilienM: hey could you take a look at https://review.openstack.org/#/c/442608/ | 13:43 |
| EmilienM | fpan: yes I will. It would be great if we could improve Etcd deployments by supporting TLS, by using what jaosorior has done. Would you have time to work on it this cycle? | 13:44 |
| fpan | EmilienM: and thanks for fixing the etcd token bug | 13:44 |
| EmilienM | fpan: no worries :-) it was fun to deploy etcd with tripleo for the first time | 13:44 |
| fpan | EmilienM: yep, I will add that, once I get this and the other etcd deployment bug resolved, my next item is to enable TLS as well as enabling RBAC for etcd | 13:45 |
| EmilienM | fpan: yes, TLS is high prio if we continue to use Etcd | 13:46 |
| fpan | EmilienM: well thanks for catching it early, it's a blessing that you found this when not many other services use etcd yet | 13:46 |
| openstackgerrit | Jiri Stransky proposed openstack/instack-undercloud master: Fix broken command prompt in stackrc https://review.openstack.org/446519 | 13:46 |
| EmilienM | fpan: cool | 13:46 |
| jaosorior | EmilienM: network is crappy, can you pass the backports? | 13:47 |
| sshnaidm | panda, hi, what's up with logs? I went over etherpad and think that we have actually completed all infra asks from us | 13:47 |
| sshnaidm | panda, is there something else we need to do? | 13:47 |
| openstackgerrit | Jiri Stransky proposed openstack/instack-undercloud master: Fix broken command prompt in stackrc https://review.openstack.org/446519 | 13:48 |
| panda | sshnaidm: remove tht, and lsof, apparently | 13:49 |
| sshnaidm | panda, is tht not useful for developers? | 13:51 |
| sshnaidm | panda, we actually didn't collected it in tripleo-ci never | 13:51 |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart-extras master: Fix ansible-lint.sh to check playbooks https://review.openstack.org/446525 | 13:51 |
| sshnaidm | panda, so there is no downgrade.. it wasn't available before | 13:52 |
| *** links has quit IRC | 13:52 | |
| panda | sshnaidm: yes, if developers want, maybe we can include a link to the comit hash used | 13:52 |
| EmilienM | jaosorior: which backports? | 13:53 |
| sshnaidm | panda, if it's patch for tht, there is no commit.. | 13:53 |
| jaosorior | EmilienM: some you mentioned before I got disconnected | 13:53 |
| sshnaidm | panda, maybe to keep rpm..? | 13:54 |
| *** oaken_chris has joined #tripleo | 13:54 | |
| shardy | jaosorior: there is http://eavesdrop.openstack.org/irclogs/%23tripleo/ if that helps | 13:54 |
| EmilienM | jaosorior: I use this url for backports: https://review.openstack.org/#/q/branch:stable/ocata+project:%22%255Eopenstack/puppet-.*%2524%22+status:open+OR+branch:stable/ocata+project:%22%255Eopenstack/tripleo-.*%2524%22+status:open | 13:54 |
| EmilienM | jaosorior: but for this specific bug, https://review.openstack.org/#/q/status:open+topic:bug/1673266 | 13:55 |
| EmilienM | trown: where are we with http://tripleo.org/cistatus.html ? | 13:55 |
| *** yatinkarel has joined #tripleo | 13:55 | |
| sshnaidm | panda, and lsof could be useful too.. ok, maybe we'll revert it later :) | 13:56 |
| trown | EmilienM: we just need to merge https://review.openstack.org/445937 ya?? | 13:57 |
| *** amoralej|lunch is now known as amoralej | 13:57 | |
| EmilienM | trown: too many patches | 13:58 |
| panda | sshnaidm: apparently 1M of lsof logs every build is wasted space. | 13:58 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Containerized undercloud - install python-heat-agents-ansible https://review.openstack.org/446052 | 13:58 |
| sshnaidm | panda, 1M is ridiculous comparing to our logs size | 13:59 |
| panda | sshnaidm: they requested to remove also GREP_COLORS which is 114 bytes. | 13:59 |
| sshnaidm | panda, yeah, I saw, no comments.. | 14:00 |
| *** salmankhan has quit IRC | 14:01 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Populate logs exclude list with infra requirements https://review.openstack.org/446374 | 14:02 |
| *** salmankhan has joined #tripleo | 14:02 | |
| *** lblanchard has joined #tripleo | 14:03 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Populate logs exclude list with infra requirements https://review.openstack.org/446374 | 14:06 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements https://review.openstack.org/440124 | 14:07 |
| *** lucas-hungry is now known as lucasagomes | 14:07 | |
| *** jaganathan has joined #tripleo | 14:08 | |
| *** psahoo has quit IRC | 14:08 | |
| *** salmankhan has quit IRC | 14:09 | |
| mwhahaha | ccamacho: i'm ok with updating the pin, i was just commenting on how it was defined it's not exactly a single version pin due to the use of ~> | 14:10 |
| ccamacho | mwhahaha awesome, thanks! | 14:11 |
| *** rlandy is now known as rlandy|mtg | 14:13 | |
| *** pkovar has quit IRC | 14:15 | |
| *** saneax is now known as saneax-_-|AFK | 14:16 | |
| *** pkovar has joined #tripleo | 14:18 | |
| *** adarazs_brb is now known as adarazs | 14:19 | |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add workflow wrapping all predeployment validations https://review.openstack.org/445914 | 14:19 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Add bigswitch agent support https://review.openstack.org/446029 | 14:20 |
| *** snecklifter_ has joined #tripleo | 14:21 | |
| *** jaganathan has quit IRC | 14:24 | |
| *** weshay is now known as weshay_pto | 14:24 | |
| *** pcaruana has quit IRC | 14:24 | |
| openstackgerrit | Feng Pan proposed openstack/puppet-tripleo master: Remove cluster_enabled setting https://review.openstack.org/446564 | 14:25 |
| *** oaken_chris has quit IRC | 14:25 | |
| openstackgerrit | Feng Pan proposed openstack/puppet-tripleo master: Remove cluster_enabled setting for etcd https://review.openstack.org/446564 | 14:26 |
| *** salmankhan has joined #tripleo | 14:26 | |
| EmilienM | adarazs, trown: meeting in 3 min? | 14:27 |
| adarazs | EmilienM: yeah, I was just about to ping people. :) | 14:28 |
| adarazs | looks like the meeting was tied to US time because it moved forward one hour in comparison to UTC... but I wouldn't mind having it now. | 14:28 |
| panda | I hate daylught saving | 14:28 |
| *** udesale has joined #tripleo | 14:29 | |
| adarazs | EmilienM, rbrady, trown, sshnaidm, weshay, panda, hrybacki, panda, rlandy|mtg, bkero: CI Squad meeting in 1 minute: https://etherpad.openstack.org/p/tripleo-ci-squad-meeting | 14:29 |
| EmilienM | let's try to do it now | 14:29 |
| *** tobias_fiberdata has quit IRC | 14:29 | |
| *** udesale has quit IRC | 14:31 | |
| *** udesale has joined #tripleo | 14:31 | |
| *** salmankhan has quit IRC | 14:32 | |
| *** funzo_ has joined #tripleo | 14:33 | |
| *** nyechiel has quit IRC | 14:33 | |
| *** salmankhan has joined #tripleo | 14:33 | |
| *** pkovar has quit IRC | 14:37 | |
| *** funzo_ has quit IRC | 14:37 | |
| openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart-extras master: overcloud-deploy: unset -e flag in deploy script https://review.openstack.org/446042 | 14:42 |
| *** cylopez has quit IRC | 14:42 | |
| panda | sshnaidm: make your failing patch depend on I4e68f24375c139e03dd4bc7659a03bdc3b661650, thanks. | 14:42 |
| *** nyechiel has joined #tripleo | 14:44 | |
| openstackgerrit | Gael Chamoulaud proposed openstack/tripleo-quickstart master: Enable ansible pipelining https://review.openstack.org/446582 | 14:45 |
| *** marst has quit IRC | 14:45 | |
| pradk | mwhahaha, so whats the goal of the role definitions commit .. to mix and match or use the templates as a stand alone? I'm a bit confused with shardy's comments | 14:48 |
| pradk | i intended the Telemetry.yaml to be a standalone custom role | 14:48 |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: WIP: Add lvm management to diskimage-builder https://review.openstack.org/444403 | 14:49 |
| pradk | hence mysql, pcmk, redis etc are part of it .. should we just keep the telemetry role limited to telemetry services and let use mix and match with HA and database role? | 14:49 |
| pradk | may be i misunderstood | 14:49 |
| *** zoli is now known as zoli|mtg|afk | 14:50 | |
| *** dbecker has quit IRC | 14:50 | |
| *** dbecker has joined #tripleo | 14:51 | |
| *** pkovar has joined #tripleo | 14:51 | |
| *** marst has joined #tripleo | 14:53 | |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Implement verify profiles as a custom action https://review.openstack.org/429684 | 14:53 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Implement check node counts as a custom action https://review.openstack.org/429757 | 14:53 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-common master: Add workflow wrapping all predeployment validations https://review.openstack.org/445914 | 14:53 |
| *** saibarspeis has quit IRC | 14:54 | |
| mwhahaha | pradk: haven't gotten caught up yet, so we should be providing roles that can be consumed in a standalone fashion. So for the telementry roles we should just have the telementry services and the users would need to provide those other services either in that role (modify it) or in a different role | 14:54 |
| *** psahoo has joined #tripleo | 14:55 | |
| pradk | so for example, controller has telemetry services and so does telemetry .. what happens when they combine both? | 14:56 |
| *** tobias_fiberdata has joined #tripleo | 14:57 | |
| *** nyechiel has quit IRC | 14:57 | |
| mwhahaha | pradk: so the telementry role should be combined with a controller that doesn't have telementry services (we should probably provide that as well) | 14:57 |
| bandini | jaosorior: mind throwing a look this way https://review.openstack.org/#/c/446121 ? (it is an easy one, promise ;) | 14:57 |
| trown | adarazs: bkero EmilienM sshnaidm panda forgot to mention on meeting, but make sure to put any of these usability patches on the phase2 topic https://review.openstack.org/#/q/status:open+topic:oooq-t-phase2 | 14:57 |
| trown | I am prioritizing ^ for reviews | 14:58 |
| pradk | mwhahaha, may be the generate role script should be smart enough to check if a service is in both roles and warn? so they dont use wrong combinations? | 14:58 |
| mwhahaha | pradk: long term yes, short term no (should be documented in the roles) | 14:58 |
| EmilienM | trown: what an excellent idea | 14:58 |
| mwhahaha | pradk: we need better ways of grouping these services together and being able to provide some sort of checkable requirements but that's not part of this effort | 14:59 |
| EmilienM | sshnaidm: I did recheck on https://review.openstack.org/#/c/431567/ ( making sure we don't break container job ) | 14:59 |
| *** ansmith has quit IRC | 14:59 | |
| pradk | mwhahaha, makes sense .. did you see shardy's capabilities map comment | 15:00 |
| mwhahaha | pradk: not yet, i'm catching up (it's only 9am :D0 | 15:00 |
| pradk | cool | 15:00 |
| *** jkilpatr has quit IRC | 15:00 | |
| mwhahaha | i'll respond and update later today | 15:00 |
| *** rlandy|mtg is now known as rlandy | 15:01 | |
| sshnaidm | EmilienM, sure | 15:02 |
| *** karimb has quit IRC | 15:02 | |
| *** nijaba has left #tripleo | 15:02 | |
| adarazs | EmilienM, trown: do you guys think we should add timestamps to the overcloud deploy log? https://thirdparty-logs.rdoproject.org/jenkins-oooq-extras-gate-rhos-10-current-passed-ci-ovb-qeos7-rhos-dev-ci-public-bond-1009/undercloud/home/stack/overcloud_deploy.log.gz | 15:04 |
| adarazs | not all lines have it, but about half of them do. :) | 15:04 |
| *** karimb has joined #tripleo | 15:04 | |
| adarazs | *most of them | 15:05 |
| trown | adarazs: dont we need all for linkability? | 15:05 |
| adarazs | trown: hm, let me check some older logs. | 15:05 |
| EmilienM | adarazs: yes please | 15:05 |
| trown | adarazs: noticed the same with undercloud where we end up with double timestamp | 15:05 |
| trown | adarazs: but better to have some double then not get linkable logs | 15:06 |
| EmilienM | timestamps for everything except config files, imho | 15:06 |
| sshnaidm | panda, this is "broken" patch: https://review.openstack.org/#/c/442415/ I think you need to depend on it in your patch, it will build for you "bad" puppet-tripleo, feel free to change it to fail earlier | 15:06 |
| adarazs | trown: yeah, we do need all I think. | 15:06 |
| adarazs | okay, so I'll add them there :) | 15:06 |
| adarazs | EmilienM: will do. | 15:06 |
| trozet | slagle, shardy: this should be good to go now: https://review.openstack.org/#/c/435081/ | 15:07 |
| *** udesale has quit IRC | 15:10 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Add oooq multinode jobs to ci status page https://review.openstack.org/445937 | 15:13 |
| EmilienM | trozet: slagle is afk this week. /me looking. | 15:13 |
| sshnaidm | adarazs, rlandy we have a tripleo-ui patch that we check gates with it, right? | 15:13 |
| adarazs | sshnaidm: yes: https://github.com/openstack/tripleo-quickstart/blob/master/ci-scripts/full-deploy.sh#L27 | 15:14 |
| EmilienM | trozet: next time, please add release notes | 15:14 |
| rlandy | sshnaidm: to test delorean gate, yes | 15:14 |
| sshnaidm | adarazs, rlandy thanks | 15:14 |
| * rlandy gets back to that review in a bit - just getting jobs spinning cleanly | 15:14 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-heat-templates master: DONT REVIEW: this is dependency patch https://review.openstack.org/446592 | 15:15 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: test new ovb with images building https://review.openstack.org/445228 | 15:16 |
| *** jkilpatr has joined #tripleo | 15:16 | |
| trozet | EmilienM: ok will do | 15:16 |
| EmilienM | trozet: feel free to do it on top of this patch (in a separated patch) | 15:16 |
| EmilienM | trown: weird, it fails: https://review.openstack.org/#/c/446511/ | 15:17 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: docker/keystone: add metadata_settings to output https://review.openstack.org/446483 | 15:17 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: docker: Add metadata_settings to optional parameters for yaml validate https://review.openstack.org/446593 | 15:17 |
| trozet | EmilienM: i plan on submitting another patch to master that will configure it as an integer for both HA and non ha scenarios, I can add it then | 15:17 |
| EmilienM | trozet: please. | 15:18 |
| EmilienM | trown: http://logs.openstack.org/11/446511/1/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/3c37e6a/logs/undercloud/home/jenkins/overcloud_deploy.log.txt.gz#_2017-03-16_14_06_58 | 15:19 |
| EmilienM | trown: sounds like apache failed to start http://logs.openstack.org/11/446511/1/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/3c37e6a/logs/subnode-1/var/log/messages.txt.gz#_Mar_16_14_06_55 | 15:20 |
| EmilienM | httpd[72062]: (98)Address already in use: AH00073: make_sock: unable to listen for connections on address [::]:8000 | 15:20 |
| EmilienM | sounds like something with heat cfn port? | 15:20 |
| *** ansmith has joined #tripleo | 15:21 | |
| EmilienM | jaosorior: do we start heat-cfn in WSGi in Ocata? | 15:21 |
| EmilienM | http://logs.openstack.org/11/446511/1/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/3c37e6a/logs/subnode-1/etc/httpd/conf.d/10-heat_api_cfn_wsgi.conf.txt.gz | 15:21 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Add spec test for tripleo::certmonger::httpd resource https://review.openstack.org/446371 | 15:21 |
| openstackgerrit | Merged openstack/puppet-tripleo master: Add spec tests for tripleo::certmonger::ca::local class https://review.openstack.org/446375 | 15:22 |
| trown | EmilienM: hmm... maybe we are missing some other backport? | 15:22 |
| EmilienM | no we don't https://github.com/openstack/tripleo-heat-templates/blob/stable/ocata/puppet/services/heat-api-cfn.yaml#L74 | 15:22 |
| jaosorior | EmilienM: no | 15:22 |
| EmilienM | trown: it sounds like a packaging issue | 15:22 |
| jaosorior | EmilienM: that's the issue that bandini was having | 15:23 |
| EmilienM | trown: we shouldn't have the heat-cfn apache | 15:23 |
| EmilienM | in ocata | 15:23 |
| jaosorior | EmilienM: which he attempted to fix here https://review.openstack.org/#/c/446121/ | 15:23 |
| bandini | yep the problem is we update to master repos on the overcloud during upgrade unconditionally | 15:24 |
| EmilienM | jaosorior: ok but my problem is not during an upgrade job | 15:24 |
| EmilienM | it's on regular oooq | 15:24 |
| jaosorior | dafqu | 15:24 |
| jaosorior | *dafuq | 15:24 |
| jaosorior | alright well | 15:24 |
| jaosorior | yeah | 15:24 |
| jaosorior | in ocata heat shouldn't be over httpd | 15:24 |
| jaosorior | and if it is, then it's the wrong package | 15:25 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Detect CREATE_COMPLETE instead of CREATE_FAILED https://review.openstack.org/443076 | 15:25 |
| *** jtomasek_ is now known as jtomasek | 15:25 | |
| trown | jaosorior: what do you mean wrong package? there is more than one? | 15:25 |
| trown | jaosorior: or wrong branch? | 15:25 |
| jaosorior | mayhaps | 15:25 |
| EmilienM | I found why | 15:26 |
| EmilienM | puppet-tripleo is deployed from master | 15:26 |
| jaosorior | funky | 15:26 |
| EmilienM | is it the master tag saga? | 15:26 |
| EmilienM | let me check the version of puppet-tripleo in ocata | 15:26 |
| EmilienM | https://trunk.rdoproject.org/centos7-ocata/current/puppet-tripleo-6.3.1-0.20170314022623.cf77c11.el7.centos.noarch.rpm | 15:27 |
| EmilienM | which is good | 15:27 |
| EmilienM | amoralej^ if you around and have some time, can you help please? | 15:28 |
| jaosorior | alright folks, I'm off, have a good day everyone! | 15:29 |
| trown | EmilienM: that is what I see in http://logs.openstack.org/11/446511/1/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/3c37e6a/logs/undercloud/var/log/extra/rpm-list.txt.gz as well | 15:29 |
| trown | EmilienM: what makes you say it uses puppet-tripleo from master? | 15:29 |
| EmilienM | in http://logs.openstack.org/11/446511/1/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/3c37e6a/logs/subnode-1/var/log/host_info.txt.gz | 15:29 |
| EmilienM | on the overcloud | 15:29 |
| EmilienM | rpm -qa | 15:29 |
| *** jaosorior has quit IRC | 15:29 | |
| trown | ah... that could be some quickstart issue | 15:29 |
| EmilienM | I have a mtg, back in 1/2h, if someone can look please | 15:30 |
| trown | since we are getting the correct thing on the undercloud but not the bootstrapped overcloud, I would guess we are not putting stable/ocata repos on overcloud | 15:30 |
| trown | EmilienM: k I will look into it | 15:30 |
| trown | yep http://logs.openstack.org/11/446511/1/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/3c37e6a/logs/subnode-1/etc/yum.repos.d/delorean.repo.txt.gz | 15:31 |
| *** funzo_ has joined #tripleo | 15:33 | |
| mandre | dprince: I get a puppet error when generating config for heat containers, Error: Could not find resource 'Service[httpd]' caused by https://github.com/openstack/puppet-heat/blob/master/manifests/api.pp#L118 | 15:34 |
| mandre | I'm surprise we don't see it in CI | 15:35 |
| mandre | dprince: I've tried using a noop resource for Service, with no luck :-/ | 15:35 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Add redux-form dependency https://review.openstack.org/445525 | 15:36 |
| *** masco has joined #tripleo | 15:37 | |
| *** zoli|mtg|afk is now known as zoli | 15:37 | |
| openstackgerrit | John Eckersberg proposed openstack/tripleo-common master: Add a Qdr Password for the Qpid dispatch router https://review.openstack.org/425890 | 15:37 |
| *** funzo_ has quit IRC | 15:38 | |
| trown | sshnaidm: bkero where does repo setup happen on the subnode in the multinode job? | 15:39 |
| *** jlinkes has quit IRC | 15:39 | |
| *** jkilpatr_ has joined #tripleo | 15:44 | |
| *** salmankhan1 has joined #tripleo | 15:46 | |
| *** ealcaniz has quit IRC | 15:46 | |
| *** nyechiel has joined #tripleo | 15:47 | |
| *** jkilpatr has quit IRC | 15:47 | |
| *** salmankhan has quit IRC | 15:49 | |
| *** salmankhan1 is now known as salmankhan | 15:49 | |
| openstackgerrit | Merged openstack/puppet-tripleo master: Add spec tests for tripleo::certmonger::mysql class https://review.openstack.org/446368 | 15:50 |
| chandankumar | sshnaidm: Hello | 15:53 |
| *** florianf has quit IRC | 15:55 | |
| *** florianf has joined #tripleo | 15:56 | |
| jrist | TFW you go to +1 something and you get a 500 | 15:56 |
| chandankumar | sshnaidm: how can i create a test job for testing tempest against mitaka? | 15:56 |
| chandankumar | in tripleo-ci | 15:56 |
| *** trown is now known as trown|lunch | 15:56 | |
| sshnaidm | trown|lunch, https://github.com/openstack-infra/tripleo-ci/blob/4b18a0c82caa046b9b54fba3bb59e905fa3234ac/toci-quickstart/playbooks/multinode.yml#L17-L17 | 15:57 |
| *** rhallisey is now known as rhallisey-brb | 15:57 | |
| *** rhallisey-brb has quit IRC | 15:57 | |
| bnemec | chandankumar: Mitaka goes out of support upstream in the near future. I would strongly suggest not spending time on new jobs for it. | 15:57 |
| *** marst_ has joined #tripleo | 15:58 | |
| sshnaidm | chandankumar, is that patch not enough https://review.openstack.org/#/c/436923/ | 15:59 |
| *** marst has quit IRC | 15:59 | |
| -openstackstatus- NOTICE: The Gerrit service on review.openstack.org is being restarted to address hung remote replication tasks, and should return to an operable state momentarily | 15:59 | |
| sshnaidm | bnemec, I think he's talking about testing patch, not a new job | 15:59 |
| bnemec | sshnaidm: Ah | 15:59 |
| *** karimb has quit IRC | 16:00 | |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common master: Create or update deployment plan from git repository https://review.openstack.org/417280 | 16:00 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: GATE CHECK https://review.openstack.org/430277 | 16:00 |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-specs master: Add gui logging spec https://review.openstack.org/395138 | 16:01 |
| chandankumar | sshnaidm: please unabandon it https://review.openstack.org/#/c/436923/ | 16:02 |
| chandankumar | sshnaidm: let me see if it works for me | 16:02 |
| *** karimb has joined #tripleo | 16:02 | |
| *** abehl has quit IRC | 16:04 | |
| EmilienM | have you seen that on mitaka ? http://logs.openstack.org/38/443038/5/check-tripleo/gate-tripleo-ci-centos-7-ovb-nonha/161cc28/console.html#_2017-03-14_08_27_27_419664 | 16:04 |
| jrist | jpich: advice plz | 16:06 |
| jrist | jpich: Honza just proposed that we ignore release notes for dependency changes | 16:07 |
| jrist | jpich: I'm fine with that, but do we need to formalize | 16:07 |
| jpich | jrist: Sounds reasonable to me, we don't have release notes with every requirement updates in the other projects either | 16:07 |
| jrist | ok! | 16:07 |
| jrist | so no | 16:08 |
| openstackgerrit | Luke Hinds proposed openstack/puppet-tripleo master: SSHD Service extensions https://review.openstack.org/443113 | 16:08 |
| jrist | just unwritten rule | 16:08 |
| *** japestinho has quit IRC | 16:10 | |
| jpich | jrist: It's not really relevant to the end user, packagers are used to looking at wherever requirements are defined so I think this works when thinking through https://docs.openstack.org/project-team-guide/release-management.html#when-to-add-release-notes , yeah :) Feel free to add it to the UI docs about adding new dependencies, if you think the UI could use some extra formalisation though | 16:10 |
| jrist | jpich: thanks! | 16:10 |
| jrist | advice taken | 16:10 |
| jrist | :) | 16:10 |
| jpich | :) | 16:11 |
| *** yprokule has quit IRC | 16:11 | |
| *** karimb has quit IRC | 16:12 | |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-validations master: Create the neutron-sanity-check validations https://review.openstack.org/381118 | 16:12 |
| *** panda is now known as panda|bbl | 16:14 | |
| dprince | mandre: Ack I will take a look | 16:17 |
| *** karimb has joined #tripleo | 16:17 | |
| *** etp has quit IRC | 16:17 | |
| *** marst_ has quit IRC | 16:20 | |
| *** marst has joined #tripleo | 16:20 | |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: create history for the overcloud deploy command https://review.openstack.org/446617 | 16:21 |
| *** dprince has quit IRC | 16:23 | |
| lhinds | ping trown|lunch : seems like the auditd module is still not in master (just pulled the new master image from CDN) | 16:24 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Make sure we upgrade to the right repos during an upgrade https://review.openstack.org/446121 | 16:25 |
| *** gbarros has quit IRC | 16:26 | |
| *** etp has joined #tripleo | 16:26 | |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: create history for the overcloud deploy command https://review.openstack.org/446617 | 16:27 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: Add redux-form dependency https://review.openstack.org/445525 | 16:29 |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: create history for the overcloud deploy command https://review.openstack.org/446617 | 16:29 |
| *** etp has left #tripleo | 16:29 | |
| *** tosky has quit IRC | 16:29 | |
| *** pkovar has quit IRC | 16:30 | |
| *** rbrady is now known as rbrady-food | 16:30 | |
| *** oaken_chris has joined #tripleo | 16:31 | |
| *** jtomasek is now known as jtomasek|afk | 16:32 | |
| openstackgerrit | Corey O'Brien proposed openstack/diskimage-builder master: Don't unmount missing paths https://review.openstack.org/446621 | 16:32 |
| *** funzo_ has joined #tripleo | 16:34 | |
| *** aufi has quit IRC | 16:35 | |
| *** jaganathan has joined #tripleo | 16:36 | |
| *** karimb has quit IRC | 16:38 | |
| *** zoli is now known as zoli|gone | 16:38 | |
| *** funzo_ has quit IRC | 16:39 | |
| *** jmelvin has quit IRC | 16:39 | |
| *** jlinkes has joined #tripleo | 16:40 | |
| *** dparkes has quit IRC | 16:41 | |
| *** ccamacho has quit IRC | 16:42 | |
| openstackgerrit | Luke Hinds proposed openstack/tripleo-heat-templates master: Extends audit serivce https://review.openstack.org/444804 | 16:46 |
| openstackgerrit | Martin André proposed openstack-infra/tripleo-ci master: Collect more info about docker https://review.openstack.org/441050 | 16:50 |
| *** flepied has quit IRC | 16:50 | |
| *** dprince has joined #tripleo | 16:50 | |
| *** gbarros has joined #tripleo | 16:51 | |
| *** Rodolof1 has joined #tripleo | 16:52 | |
| EmilienM | sshnaidm: any idea about why puppet-tripleo is deployed from master on stable/ocata overclouds? | 16:53 |
| *** Rodolof1 has left #tripleo | 16:54 | |
| *** pkovar has joined #tripleo | 16:54 | |
| *** [1]cdearborn has joined #tripleo | 16:55 | |
| *** tosky has joined #tripleo | 16:55 | |
| *** rwsu has joined #tripleo | 16:56 | |
| *** cdearborn has quit IRC | 16:56 | |
| *** rhallisey has joined #tripleo | 16:59 | |
| openstackgerrit | Merged openstack/instack-undercloud master: Don't rely on umask to set permissions on undercloud-passwords.conf https://review.openstack.org/446083 | 16:59 |
| EmilienM | trown|lunch: I'm back from meeting, looking at the issue | 17:00 |
| *** Rodolof1 has joined #tripleo | 17:02 | |
| *** fragatina has joined #tripleo | 17:04 | |
| EmilienM | trown|lunch: it's not only puppet-tripleo but all puppet modules | 17:04 |
| *** fragatina has quit IRC | 17:04 | |
| *** fragatina has joined #tripleo | 17:05 | |
| EmilienM | trown|lunch: same for all other packages (Nova, etc): all from master :/ | 17:05 |
| *** marst_ has joined #tripleo | 17:07 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: Keep existing data for containerized ironic-conductor https://review.openstack.org/443173 | 17:07 |
| *** psahoo has quit IRC | 17:08 | |
| *** gchamoul is now known as gchamoul|afk | 17:09 | |
| *** marst has quit IRC | 17:09 | |
| *** rcernin has joined #tripleo | 17:12 | |
| EmilienM | sshnaidm, trown|lunch: i'm trying to see if it can be https://review.openstack.org/#/c/446129/1 | 17:15 |
| dprince | mandre: have you filed a bug on the heat-api issue? If not, is there a failing CI job you can link me too? | 17:15 |
| mandre | dprince: I don't see it failing in CI, that's the thing | 17:17 |
| mandre | dprince: maybe there was no promotion for puppet-heat since a long time, idk | 17:17 |
| EmilienM | mandre: puppet modules don't need promotions | 17:18 |
| EmilienM | they are deloyed from current | 17:18 |
| EmilienM | what is the issue? | 17:18 |
| dprince | mandre: this was added in November | 17:18 |
| *** mcornea has quit IRC | 17:18 | |
| mandre | dprince: it was merged 2 weeks ago | 17:19 |
| mandre | commit is dated from november, but it took time to land | 17:20 |
| *** lucasagomes is now known as lucas-afk | 17:21 | |
| EmilienM | mandre: what is the issue? | 17:22 |
| *** flepied has joined #tripleo | 17:22 | |
| mandre | EmilienM: in my local env, the puppet config generation chokes on a Service resource, probably because we don't run systemd in the containers, but the strange thing is that we don't see it in CI | 17:22 |
| sshnaidm | EmilienM, what is the link? | 17:23 |
| dprince | mandre: oh, I see. good catch | 17:24 |
| sshnaidm | EmilienM, it was an issue before, but should be solved now | 17:24 |
| *** jpich has quit IRC | 17:24 | |
| *** jaganathan has quit IRC | 17:26 | |
| *** lmiccini has quit IRC | 17:28 | |
| *** rcernin has quit IRC | 17:28 | |
| *** trown|lunch is now known as trown | 17:29 | |
| EmilienM | sshnaidm: solved how and when? | 17:30 |
| EmilienM | sshnaidm: see http://logs.openstack.org/11/446511/1/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/3c37e6a/logs/subnode-1/etc/yum.repos.d/delorean.repo.txt.gz | 17:30 |
| trown | EmilienM: sshnaidm ya I am not really understanding how the master repo gets put there | 17:30 |
| openstackgerrit | Dan Trainor proposed openstack/tripleo-validations master: OverCloud Ceilomter Events Sane Defaults https://review.openstack.org/446287 | 17:31 |
| *** gfidente is now known as gfidente|afk | 17:31 | |
| trown | EmilienM: sshnaidm looking at the tripleo.sh output in the console log it is putting ocata repo | 17:31 |
| trown | and the undercloud has the ocata repo, so it seems like the overcloud would too | 17:31 |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: WIP: Add lvm management to diskimage-builder https://review.openstack.org/444403 | 17:31 |
| EmilienM | yeah undercloud is fine | 17:34 |
| *** funzo_ has joined #tripleo | 17:35 | |
| EmilienM | also, why do we pull puppet 3.8? | 17:35 |
| EmilienM | Verifying : puppet-3.8.7-1.el7.noarch | 17:35 |
| EmilienM | ah wait no | 17:35 |
| EmilienM | puppet-4.6.2-2.el7.noarch | 17:35 |
| EmilienM | it got overriden by rdo | 17:36 |
| *** derekh has quit IRC | 17:36 | |
| *** fultonj has quit IRC | 17:36 | |
| *** fultonj has joined #tripleo | 17:36 | |
| *** athomas has quit IRC | 17:37 | |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: [WIP] Testing if repo-setup role is working on stable branch https://review.openstack.org/446647 | 17:37 |
| trown | sshnaidm: EmilienM testing if it is our call to repo-setup role that is screwing things up ^ | 17:37 |
| trown | sshnaidm: EmilienM we still do tripleo.sh bootstrap, and it looks to be creating ocata repos as expected, so I can only figure that the repo-setup role is to blame | 17:38 |
| sshnaidm | trown, hmm.. before this it was bootstrap which set up master repos and our repo-setup worked as expected | 17:38 |
| trown | sshnaidm: k, well the above patch will tell us if that is true at least :P ... just trying to reduce variables to understand what is happening | 17:39 |
| *** funzo_ has quit IRC | 17:39 | |
| sshnaidm | trown, http://logs.openstack.org/11/446511/1/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/3c37e6a/logs/subnode-1/home/jenkins/repo_setup.log.txt.gz | 17:39 |
| sshnaidm | trown, it downloads ocata repos as I see | 17:40 |
| trown | sshnaidm: hmm indeed... and tripleo.sh output shows the same... | 17:41 |
| EmilienM | yeah it deploys https://trunk.rdoproject.org/centos7-ocata/20/b7/20b7a28e46d9d69a5680e564f2937672c153a3aa_141b161f | 17:41 |
| sshnaidm | trown, but here it's already pike, is it? http://logs.openstack.org/11/446511/1/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/3c37e6a/logs/subnode-1/home/jenkins/install_built_repo.log.txt.gz | 17:41 |
| EmilienM | which is good | 17:41 |
| trown | sshnaidm: indeed | 17:42 |
| * trown is confused where that is coming from | 17:43 | |
| sshnaidm | trown, oh.. yet another step | 17:43 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Keep existing data when moving to containerized MariaDB https://review.openstack.org/441146 | 17:44 |
| sshnaidm | trown, I think we use role-setup included in undercloud-setup role: https://github.com/openstack-infra/tripleo-ci/blob/4b18a0c82caa046b9b54fba3bb59e905fa3234ac/toci-quickstart/playbooks/multinode.yml#L32-L32 | 17:44 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: Add timestamps to quickstart logs https://review.openstack.org/446075 | 17:45 |
| sshnaidm | trown, so we run repo-setup actually twice.. but it doesn't explain where are pike repos from.. | 17:46 |
| trown | sshnaidm: ya though maybe that second run is what fixes the undercloud? | 17:46 |
| *** shardy has quit IRC | 17:46 | |
| trown | since the undercloud actually has correct repos, and it is the only place where we run twice | 17:46 |
| sshnaidm | trown, but it's the same role, same playbook.. | 17:47 |
| trown | ya... it is called diferently... but I agree | 17:47 |
| trown | include_role vs. role: | 17:48 |
| trown | but the behavior *should* be the same | 17:48 |
| *** dbecker has quit IRC | 17:49 | |
| skramaja | EmilienM: the patch https://review.openstack.org/#/c/418348/ is ready, can you remove the -2 and have a look? | 17:50 |
| *** tosky has quit IRC | 17:50 | |
| *** jlinkes has quit IRC | 17:52 | |
| *** dmacpher has joined #tripleo | 17:52 | |
| EmilienM | skramaja: sure | 17:53 |
| *** nyechiel has quit IRC | 17:53 | |
| *** fragatina has quit IRC | 17:54 | |
| *** tosky has joined #tripleo | 17:55 | |
| sshnaidm | trown, actually on subnode we run only repo-setup and install-built-repo roles, and all these tripleo.sh bootstrap things.. | 17:57 |
| trown | sshnaidm: right | 17:57 |
| *** yamahata has joined #tripleo | 17:58 | |
| *** masco has quit IRC | 17:59 | |
| *** jkilpatr has joined #tripleo | 18:00 | |
| *** jkilpatr_ has quit IRC | 18:03 | |
| *** jmelvin has joined #tripleo | 18:04 | |
| trown | sshnaidm: hmm tripleo-ci patch is not triggering stable branch jobs | 18:05 |
| *** dmacpher is now known as dmacpher-afk | 18:05 | |
| sshnaidm | trown, yeah, then need to use tht or kind of.. | 18:06 |
| *** jpena is now known as jpena|off | 18:07 | |
| openstackgerrit | John Trowbridge proposed openstack/puppet-tripleo master: DNM testing scenario gates https://review.openstack.org/445977 | 18:08 |
| *** oaken_chris has quit IRC | 18:09 | |
| bnemec | We actually should add stable multinode jobs to tripleo-ci too, like we have for ovb. | 18:11 |
| *** fzdarsky is now known as fzdarsky|afk | 18:11 | |
| trown | ya | 18:11 |
| *** gbarros has quit IRC | 18:16 | |
| *** jmelvin has quit IRC | 18:22 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements https://review.openstack.org/440124 | 18:24 |
| *** rcernin has joined #tripleo | 18:29 | |
| *** akrivoka has quit IRC | 18:30 | |
| *** dprince has quit IRC | 18:31 | |
| *** gbarros has joined #tripleo | 18:31 | |
| *** dprince has joined #tripleo | 18:35 | |
| *** funzo has joined #tripleo | 18:36 | |
| *** yamahata has quit IRC | 18:38 | |
| EmilienM | trown: did you miss Depends-On ? or no? | 18:39 |
| *** dprince has quit IRC | 18:39 | |
| *** dprince has joined #tripleo | 18:40 | |
| *** funzo has quit IRC | 18:40 | |
| trown | EmilienM: on https://review.openstack.org/446647 ? | 18:40 |
| trown | EmilienM: will depends-on work to run stable jobs? seems like it would just get the change from master since it is the same change-id | 18:41 |
| trown | EmilienM: was trying to figure out how to do that | 18:41 |
| EmilienM | trown: if you want to try tripleo-ci in stable multinode jobs, submit a patch in THT or puppet-tripleo stable/ocata with Depends-On the tripleo-ci patch | 18:42 |
| EmilienM | does it make sense? | 18:42 |
| *** tesseract has quit IRC | 18:42 | |
| trown | ah right just a direct fake patch... ya makes sense | 18:42 |
| EmilienM | sshnaidm, trown: I guess it's the same problem with stable/newton things, I haven't tested yet though | 18:43 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates stable/ocata: DNM dummy commit to test stable multinode jobs https://review.openstack.org/446691 | 18:45 |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates stable/ocata: DNM dummy commit to test stable multinode jobs https://review.openstack.org/446691 | 18:45 |
| EmilienM | it should work now | 18:46 |
| trown | EmilienM: ya I would be even more confused if it was any different for stable/newton | 18:46 |
| *** rbrady-food is now known as rbrady | 18:47 | |
| *** amoralej is now known as amoralej|off | 18:48 | |
| *** gbarros has quit IRC | 18:49 | |
| *** salmankhan1 has joined #tripleo | 18:53 | |
| *** salmankhan has quit IRC | 18:54 | |
| *** salmankhan1 is now known as salmankhan | 18:54 | |
| *** tbonds has joined #tripleo | 18:55 | |
| openstackgerrit | Ben Nemec proposed openstack/tripleo-specs master: Policy on Adding CI Jobs https://review.openstack.org/446102 | 18:55 |
| EmilienM | mandre: ouch, now I don't see any logs on http://logs.openstack.org/50/441050/14/experimental/gate-tripleo-ci-centos-7-undercloud-containers/d8c7236/ | 18:56 |
| *** rcernin has quit IRC | 18:58 | |
| *** suuuper has quit IRC | 19:01 | |
| *** bogdando has quit IRC | 19:03 | |
| *** fragatina has joined #tripleo | 19:06 | |
| *** fragatina has quit IRC | 19:07 | |
| *** pkovar has quit IRC | 19:07 | |
| *** fragatina has joined #tripleo | 19:07 | |
| *** yamahata has joined #tripleo | 19:10 | |
| *** ckyriakidou has quit IRC | 19:12 | |
| *** salmankhan has quit IRC | 19:13 | |
| beagles | bnemec, EmilienM: if you get a moment: https://review.openstack.org/#/c/434472/ | 19:17 |
| mandre | EmilienM: yeah! it's totally puzzling me | 19:18 |
| *** jmelvin has joined #tripleo | 19:19 | |
| mandre | EmilienM: if you look at another infra job, you'll see the logs are there, for instance http://logs.openstack.org/50/441050/14/check/gate-tripleo-ci-centos-7-undercloud-upgrades-nv/ | 19:19 |
| *** jkilpatr_ has joined #tripleo | 19:19 | |
| openstackgerrit | Zane Bitter proposed openstack/tripleo-heat-templates master: Use the make_url function to build URLs https://review.openstack.org/446704 | 19:19 |
| openstackgerrit | Zane Bitter proposed openstack/tripleo-heat-templates master: Use the make_url function in the endpoint map https://review.openstack.org/446705 | 19:19 |
| EmilienM | mandre: it's not a container job | 19:20 |
| beagles | make_url function.. neat | 19:20 |
| mandre | EmilienM: right, but the postci is using the same code path as far as I can tell | 19:21 |
| beagles | EmilienM: thx | 19:21 |
| EmilienM | beagles: approved though they'll fail. stable jobs fail on oooq | 19:21 |
| beagles | is oooq a voting job on the os-net-config repo? | 19:21 |
| bnemec | beagles: EmilienM: That kind of sounds like a feature backport. | 19:21 |
| beagles | bnemec: it fixes an SR-IOV configuration shortcoming | 19:22 |
| beagles | the NM_CONTROLLED is for the same thing really | 19:22 |
| beagles | well, not the same thing, but of SR-IOV | 19:22 |
| beagles | s/of/for/ | 19:22 |
| mandre | EmilienM: the logs disappeared between PS7 and PS8 | 19:23 |
| *** jkilpatr has quit IRC | 19:23 | |
| EmilienM | beagles: ah you're right no | 19:23 |
| beagles | bnemec: basically what happens if we don't configure hotplug is that interfaces that were used as physical functions aren't "brought back to life" properly when the VM that was using it is destroyed | 19:23 |
| beagles | bnemec: it is a epic tale full of tears and tragedy | 19:23 |
| *** gbarros has joined #tripleo | 19:24 | |
| mandre | EmilienM: and I was briefly able to restore them with PS11 | 19:24 |
| bnemec | beagles: Okay, I guess that makes sense. | 19:24 |
| bnemec | I just want to make sure we can justify it if the stable folks come asking why we allowed the backport. | 19:24 |
| mandre | EmilienM: but why... this is still a mistery | 19:24 |
| beagles | bnemec: absolutely | 19:25 |
| EmilienM | trown, sshnaidm: can we close https://trello.com/c/pJaJ2O90/108-tripleo-multinode-jobs-failing-on-missing-variable-multinode-mode ? | 19:25 |
| trown | EmilienM: ya | 19:25 |
| sshnaidm | trown, maybe to create another card how to gate building in ci.. | 19:26 |
| bkero | trown: do you have a link to some build logs under the new gating scripts? | 19:26 |
| EmilienM | trown, sshnaidm: I created https://trello.com/c/PmGU7ErU/110-tripleo-quickstart-ocata-newton-overcloud-is-deployed-with-pike-repos | 19:26 |
| bkero | I don't think quickstar.tar (venv) is in there, but I want to make sure | 19:26 |
| *** liverpooler has quit IRC | 19:27 | |
| bkero | and i don't have some logs handy -- and it would be silly to run tests just for that | 19:27 |
| trown | bkero: I think http://logs.openstack.org/11/446511/1/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/3c37e6a/ is pretty recent | 19:27 |
| mandre | sshnaidm, trown: do you guys have an idea why the log collection would fail for the undercloud containers job for https://review.openstack.org/#/c/441050/? | 19:27 |
| *** jmelvin has quit IRC | 19:28 | |
| *** jmelvin has joined #tripleo | 19:28 | |
| bkero | trown: thanks | 19:28 |
| openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud master: Add option to configure ceilometer with mongodb backend https://review.openstack.org/446707 | 19:29 |
| *** liverpooler has joined #tripleo | 19:30 | |
| sshnaidm | mandre, trown yeah, infra's collecting logs task failed: http://paste.openstack.org/show/603017/ | 19:30 |
| sshnaidm | mandre, hmm.. are all those symlinks? | 19:30 |
| mandre | sshnaidm: very likely, it's a direct copy from the containers' /etc | 19:31 |
| sshnaidm | mandre, ok, I'll submit a patch for deleting them, but we need to copy files, not symlinks in collect-docker-logs task | 19:33 |
| openstackgerrit | Gabriele Cerami proposed openstack/puppet-tripleo master: DONT REVIEW: test failure https://review.openstack.org/442415 | 19:33 |
| mandre | sshnaidm: I'll delete all the symlinks after the copy | 19:34 |
| sshnaidm | mandre, do we need this 99-sysctl.conf at all? | 19:34 |
| EmilienM | FYI https://bugs.launchpad.net/tripleo/+bug/1673585 | 19:35 |
| openstack | Launchpad bug 1673585 in tripleo "quickstart: ocata/newton overclouds are deployed with pike repos" [Critical,Triaged] | 19:35 |
| trown | should have logs from the test patch shortly | 19:35 |
| trown | it is on overcloud deploy now | 19:36 |
| EmilienM | yeah it's deploying the overcloud now | 19:36 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Delete symlinks and other non-files when collect logs https://review.openstack.org/446711 | 19:36 |
| sshnaidm | mandre, ^^ | 19:36 |
| *** funzo has joined #tripleo | 19:36 | |
| sshnaidm | mandre, you can try to depend on this patch and see if it helps ^ | 19:37 |
| openstackgerrit | Martin André proposed openstack-infra/tripleo-ci master: Collect more info about docker https://review.openstack.org/441050 | 19:37 |
| *** tzumainn is now known as tzumainn|bbl | 19:37 | |
| *** skramaja has quit IRC | 19:37 | |
| mandre | sshnaidm: this job is not using oooq yet | 19:38 |
| sshnaidm | mandre, uh.. ok, then we made it for future :) | 19:39 |
| mandre | sshnaidm: I would never have found out for the symlinks, was it somewhere in the logs? | 19:40 |
| sshnaidm | mandre, http://logs.openstack.org/50/441050/14/experimental/gate-tripleo-ci-centos-7-undercloud-containers/d8c7236/_zuul_ansible/ansible_log.txt | 19:41 |
| *** funzo has quit IRC | 19:41 | |
| bkero | Ok, cool. As I suspected, new log sizes are much smaller. | 19:42 |
| bkero | It's gone down from 80MB per job to 15MB. | 19:42 |
| mandre | sshnaidm: it was just in front of my nose... | 19:42 |
| mandre | sshnaidm: I owe you a big thank you | 19:43 |
| sshnaidm | mandre, np :) | 19:43 |
| EmilienM | bkero: which patch does that? | 19:45 |
| bkero | EmilienM: panda|bbl's gate runner patch | 19:45 |
| bkero | It stopped including a tarred virtualenv in the logs | 19:45 |
| bkero | EmilienM: this line is no longer being executed: http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/toci_instack_oooq_multinode.sh#n137 | 19:46 |
| openstackgerrit | Dmitry Tantsur proposed openstack/puppet-tripleo master: Explicitly configure credentials used by ironic to access other services https://review.openstack.org/446037 | 19:50 |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates master: Explicitly configure credentials used by ironic to access other services https://review.openstack.org/446074 | 19:52 |
| *** jmelvin has quit IRC | 19:54 | |
| *** lblanchard has quit IRC | 19:55 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-docs master: Document how to configure OpenStack API policies https://review.openstack.org/446039 | 19:56 |
| *** dparkes has joined #tripleo | 19:59 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-heat-templates master: DO NOT MERGE: testing ironic https://review.openstack.org/428053 | 20:00 |
| EmilienM | trown: ok it failed :D | 20:01 |
| EmilienM | we should have logs in a few | 20:01 |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Re-Add bigswitch agent support https://review.openstack.org/446029 | 20:04 |
| jkilpatr_ | is there a bug tracking this setting | 20:06 |
| jkilpatr_ | https://github.com/openstack/instack-undercloud/blob/master/undercloud.conf.sample#L193 | 20:06 |
| jkilpatr_ | can't seem to find one with search | 20:06 |
| EmilienM | trown, sshnaidm : logs with John's patch http://logs.openstack.org/91/446691/2/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/503b595/logs/ | 20:06 |
| trown | EmilienM: ya same thing... so it is not the quickstart repo-setup role which is at fault... | 20:07 |
| EmilienM | why do we have [delorean-current] ? | 20:08 |
| EmilienM | and that? | 20:08 |
| EmilienM | http://logs.openstack.org/91/446691/2/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/503b595/logs/subnode-1/etc/yum.repos.d/delorean-deps.repo.txt.gz | 20:08 |
| EmilienM | pike-testing | 20:08 |
| EmilienM | dprince: can you update the dashboard to remove the margin on the left? http://tripleo.org/cistatus.html | 20:09 |
| openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud master: Add option to configure ceilometer with mongodb backend https://review.openstack.org/446707 | 20:09 |
| *** florianf has quit IRC | 20:09 | |
| trown | I think we must not be getting the STABLE_RELEASE var on the subnode, so when tripleo.sh subnode bootstrap happens it is putting master repos there | 20:09 |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1673585 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1673585 in tripleo "quickstart: ocata/newton overclouds are deployed with pike repos" [Critical,Triaged] | 20:10 |
| sshnaidm | trown, panda|bbl had a patch to resolve this.. | 20:10 |
| EmilienM | trown: well, why would it work for non-oooq jobs? | 20:10 |
| trown | sshnaidm: know where that is? | 20:10 |
| sshnaidm | trown, I mean that was merged | 20:11 |
| trown | EmilienM: we are probably calling tripleo.sh wrong in the oooq jobs :P | 20:11 |
| dprince | +EmilienM: I thought I merge that github patch already? | 20:11 |
| EmilienM | https://review.openstack.org/#/c/445866/11/toci_gate_test-oooq.sh | 20:11 |
| dprince | EmilienM: it should auto update | 20:11 |
| trown | EmilienM: or doing something wrong in the toci script anyways | 20:11 |
| EmilienM | that? | 20:11 |
| sshnaidm | trown, and if looking at bootstrap logs you see that it's ocata repos deployed there | 20:11 |
| EmilienM | dprince: see tripleo.org/cistatus.html | 20:11 |
| trown | sshnaidm: ya but check baseurl in http://logs.openstack.org/91/446691/2/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/503b595/logs/subnode-1/etc/yum.repos.d/delorean.repo.txt.gz | 20:12 |
| trown | sshnaidm: that tells us it was not put there by repo-setup role | 20:12 |
| bnemec | EmilienM: It should be gone. You may need to Shift+F5 to force a reload of the CSS. | 20:12 |
| sshnaidm | trown, http://logs.openstack.org/91/446691/2/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/503b595/logs/undercloud/var/log/bootstrap-subnodes.log.txt.gz | 20:12 |
| trown | sshnaidm: we dont keep the hash (though we probably should) | 20:12 |
| bnemec | dprince: For future reference, it's worth noting that I had to rebuild the tripleo-docs tox environment on tripleo.org to get that change to actually take effect. | 20:13 |
| sshnaidm | trown, you disabled repo-setup in your patch, right? | 20:13 |
| bnemec | I'm guess python setup.py install doesn't update the code in the venv. | 20:13 |
| trown | sshnaidm: right, that is another way to be sure ;P | 20:13 |
| openstackgerrit | Tim Rozet proposed openstack/puppet-tripleo master: Enables OpenDaylight Clustering in HA deployments https://review.openstack.org/425383 | 20:13 |
| bnemec | It was still using the old tripleosphinx bits. | 20:13 |
| dprince | bnemec: ack, you can update the deployment script to do that automatically if you want | 20:13 |
| EmilienM | bnemec, dprince: sorry I had cache, indeed | 20:13 |
| EmilienM | dprince: everything is cool now! | 20:13 |
| bnemec | EmilienM: And now you can display the whole page on a mere 1920 pixel wide screen. :-) | 20:14 |
| *** dbecker has joined #tripleo | 20:14 | |
| EmilienM | yeah :D | 20:14 |
| sshnaidm | trown, but I wonder why we don't overwrite these repos.. quickstart runs after all tripleo.sh part\ | 20:15 |
| *** rbrady is now known as rbrady-afk | 20:17 | |
| *** morazi has quit IRC | 20:17 | |
| EmilienM | sshnaidm, trown: i'm trying to query logstash if we already ran a successful oooq-multinode in stable branches | 20:19 |
| mwhahaha | trozet: i have concerns about the puppet-opendaylight module (it doesn't look idempotent) | 20:19 |
| mwhahaha | trozet: also it pulls in a yumrepo | 20:21 |
| trown | sshnaidm: hmm the packages from master are installed during overcloud deploy http://logs.openstack.org/91/446691/2/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/503b595/logs/subnode-1/var/log/yum.log.txt.gz http://logs.openstack.org/91/446691/2/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/503b595/console.html#_2017-03-16_19_35_12_179102 | 20:21 |
| * trown wonders if it is the deployed server code itself doing this | 20:22 | |
| EmilienM | mhh | 20:23 |
| sshnaidm | trown, it means that master repos are there before it deploys, it just uses system repos, doesn't it? | 20:23 |
| sshnaidm | trown, I saw master repos in install-built-repo role too, yet before overcloud deploy starts | 20:23 |
| trown | ah right, makes sense so somewhere between the bootstrap and install-built-repo we get master repos | 20:24 |
| trown | wtf | 20:24 |
| EmilienM | trozet: I agree the code is not super clean | 20:24 |
| EmilienM | trown, sshnaidm: do we have the same problem with regular jobs? | 20:25 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Always rebuild docs venv for tripleo-docs https://review.openstack.org/446724 | 20:25 |
| trown | EmilienM: non stable jobs? we wouldnt know because there we intend to use master | 20:25 |
| EmilienM | see https://review.openstack.org/#/c/446506/ | 20:25 |
| trown | EmilienM: so I would bet we have the same thing happening on master jobs, it just doesnt interfere | 20:26 |
| EmilienM | gate-tripleo-ci-centos-7-nonha-multinode-updates-nv works fine | 20:26 |
| EmilienM | and puppet-tripleo-6.3.1-0.20170314022623.cf77c11.el7.centos.noarch is the right version on the overcloud | 20:26 |
| EmilienM | so it's something with oooq | 20:26 |
| EmilienM | see http://logs.openstack.org/06/446506/1/check/gate-tripleo-ci-centos-7-nonha-multinode-updates-nv/ac9bc0a/logs/subnode-2/rpm-qa.txt.gz | 20:26 |
| trown | EmilienM: ya something with the oooq runner script anyways | 20:26 |
| *** dbecker has quit IRC | 20:27 | |
| * EmilienM keeps diging | 20:27 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: test ocata branches https://review.openstack.org/446728 | 20:29 |
| trown | sshnaidm: nice I was just about to do something like that | 20:29 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-heat-templates stable/ocata: DONT REVIEW: test ocata https://review.openstack.org/446729 | 20:29 |
| *** dprince has quit IRC | 20:29 | |
| sshnaidm | trown, yeah, let's check repos after each step | 20:29 |
| trown | sshnaidm: is it possible to revert just the stable jobs running via oooq? if we cant find a solution quickly | 20:31 |
| EmilienM | we need to look why we enable delorean-current I think | 20:31 |
| *** tbonds has quit IRC | 20:32 | |
| trown | EmilienM: that is actually what makes me think it happens before we run quickstart ... the delorean-current repo there does not match how quickstart (incorrectly) templates it | 20:32 |
| trown | EmilienM: ie it has the git hash baseurl rather than just /current/ | 20:32 |
| EmilienM | yeah it's probably in scripts/tripleo.sh | 20:32 |
| trown | EmilienM: or how the quickstart runner script is calling that | 20:33 |
| EmilienM | I looked at old CI jobs and they don't have delorean-current in stable/ocata (overcloud) | 20:33 |
| trown | sshnaidm: mind if I add a couple more "cat repos" to your patch | 20:34 |
| EmilienM | yeah I confirm, so : | 20:34 |
| EmilienM | on classic jobs, delorean-current is only enabled on master, not on stable/ocata | 20:34 |
| EmilienM | on oooq jobs, delorean-current is always deployed | 20:34 |
| sshnaidm | trown, sure | 20:35 |
| sshnaidm | trown, I'm not sure it's possible to revert only stable branch jobs.. | 20:35 |
| sshnaidm | trown, we can disable them, but revert... | 20:35 |
| EmilienM | I think we're close :D | 20:36 |
| bnemec | sshnaidm: Can't you just redirect to toci_gate_test_orig.sh like you do with ovb? | 20:36 |
| EmilienM | yeah we could fake the job mayeb | 20:36 |
| sshnaidm | bnemec, yeah, I think it's possible | 20:36 |
| sshnaidm | bnemec, in case of stable branch, right? | 20:36 |
| sshnaidm | bnemec, but we have a different TOCI_JOBTYPE | 20:36 |
| EmilienM | yeah it sounds like STABLE_RELEASE is empty in oooq stable/ocata jobs | 20:37 |
| *** jkilpatr_ has quit IRC | 20:37 | |
| bnemec | Oh, ugh. | 20:37 |
| bnemec | That probably wouldn't work then. | 20:37 |
| sshnaidm | bnemec, so we can actually to replace it also in script.. | 20:37 |
| *** funzo has joined #tripleo | 20:37 | |
| sshnaidm | bnemec, just set it to old one | 20:37 |
| sshnaidm | bnemec, and if I didn't forget anything else, it may work.. | 20:38 |
| bnemec | sshnaidm: Sounds like a simple patch to try if nothing else. | 20:38 |
| sshnaidm | bnemec, will try now.. | 20:39 |
| trown | I wonder if we need this commented code https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/common_functions.sh#L353-L359 | 20:39 |
| EmilienM | trown: let's try it | 20:40 |
| EmilienM | trown: let me try it | 20:40 |
| *** funzo has quit IRC | 20:42 | |
| EmilienM | panda|bbl: when you around fyi ^ | 20:42 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: common_functions: uncomment deploy.env code for echo_vars_to_deploy_env_oooq https://review.openstack.org/446732 | 20:43 |
| *** ansmith has quit IRC | 20:44 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo stable/ocata: DNM - Test common_functions change in TripleO CI https://review.openstack.org/446733 | 20:44 |
| *** rwsu has quit IRC | 20:44 | |
| EmilienM | ok let's see | 20:45 |
| panda|bbl | trown: that should be needed only for 3nodes | 20:45 |
| EmilienM | why? | 20:45 |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: DONT REVIEW: test ocata branches https://review.openstack.org/446728 | 20:45 |
| panda|bbl | because in the original script the OVERCLOUD_ROLES variable was defined only under 3nodes jobs | 20:46 |
| *** panda|bbl is now known as panda | 20:46 | |
| openstackgerrit | John Trowbridge proposed openstack/tripleo-heat-templates stable/ocata: DONT REVIEW: test ocata https://review.openstack.org/446729 | 20:46 |
| panda | I have like 2 neurons left for tonight | 20:46 |
| panda | and one is saying "I'm sleepy" | 20:46 |
| trown | k... I added some more debug to sshnaidm patch (before quickstart runs) hopefully it will help figure out what is going on | 20:47 |
| trown | need to do family stuff for a bit but will check back later | 20:47 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Revert stable branch jobs to work without oooq https://review.openstack.org/446734 | 20:47 |
| EmilienM | trown: ok so | 20:47 |
| sshnaidm | trown, bnemec, panda in case we don't fix it quickly ^^ | 20:47 |
| EmilienM | trown, panda, sshnaidm: if we don't find a solution tonight, we try to do the revert thing by sshnaidm | 20:48 |
| sshnaidm | not sure it will work, panda wdyt? | 20:48 |
| EmilienM | ok? | 20:48 |
| trown | sounds good | 20:48 |
| EmilienM | k | 20:48 |
| sshnaidm | I hope we'll find the problem.. | 20:48 |
| EmilienM | but it sounds like my patch is useless | 20:48 |
| EmilienM | if panda's neuron is right | 20:48 |
| trown | lol | 20:49 |
| trown | can a single neuron even hold a thought? | 20:49 |
| *** Goneri has quit IRC | 20:50 | |
| panda | I had this "ready" https://review.openstack.org/445461 .. | 20:50 |
| panda | no stable branch is workign ? | 20:52 |
| EmilienM | panda: no | 20:52 |
| *** jayg is now known as jayg|g0n3 | 20:56 | |
| panda | are we clearing puppet dir on subnodes ? | 20:57 |
| *** jkilpatr has joined #tripleo | 20:58 | |
| bkero | I believe that's part of bootstrap-subnodes | 20:59 |
| bkero | but we should verify | 20:59 |
| bkero | sudo rm -rf /etc/puppet /etc/hiera.yaml | 20:59 |
| bkero | yes | 20:59 |
| EmilienM | well, not sure it's related | 20:59 |
| EmilienM | because again, the problem is that delorean-current is deployed | 20:59 |
| EmilienM | so it's all packages that are deployed from master | 20:59 |
| EmilienM | see http://logs.openstack.org/91/446691/2/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/503b595/logs/subnode-1/etc/yum.repos.d/delorean-current.repo.txt.gz | 21:01 |
| EmilienM | and the last line | 21:01 |
| EmilienM | it's done here: https://github.com/openstack-infra/tripleo-ci/blob/21ec3361d363e38e758fa3da10ca7e4a9e8e99ce/scripts/tripleo.sh#L315-L332 | 21:02 |
| EmilienM | which means, at some point in the job STABLE_RELEASE is empty | 21:02 |
| openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud master: Add option to configure ceilometer with mongodb backend https://review.openstack.org/446707 | 21:03 |
| EmilienM | panda: we are missing deploy.env file in the logs, which was useful to see ENVs | 21:05 |
| EmilienM | for ex: http://logs.openstack.org/24/440124/25/check/gate-tripleo-ci-centos-7-nonha-multinode-updates-nv/6cc832d/logs/deploy.env | 21:05 |
| *** abishop has quit IRC | 21:06 | |
| *** trown is now known as trown|outtypewww | 21:07 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: fallback to old method on stable branches https://review.openstack.org/445461 | 21:09 |
| *** jmelvin has joined #tripleo | 21:09 | |
| panda | EmilienM: not even undercloud job is working correctly ? | 21:09 |
| EmilienM | panda: undercloud works fine | 21:09 |
| EmilienM | it's just overcloud (subnode) | 21:09 |
| EmilienM | I think subnode don't get the env | 21:09 |
| EmilienM | so STABLE_RELEASE is empty | 21:10 |
| bkero | EmilienM: What environment variables does the subnode need? | 21:10 |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1673585 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1673585 in tripleo "quickstart: ocata/newton overclouds are deployed with pike repos" [Critical,Triaged] | 21:10 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Added release note for NeutronExternalNetworkBridge deprecation https://review.openstack.org/440615 | 21:10 |
| EmilienM | bkero: I don't know them all tbj | 21:10 |
| bkero | We can add that to the quickstart-extras role | 21:10 |
| EmilienM | tbh* | 21:10 |
| EmilienM | but STABLE_RELEASE for sure | 21:10 |
| *** salmankhan has joined #tripleo | 21:10 | |
| panda | the test that was working before on multinode stable branch reported openstack-nova newton when I checked | 21:10 |
| EmilienM | panda: can you show it? | 21:11 |
| EmilienM | I couldn't find an oooq multinode job that worked on stable branch | 21:11 |
| bkero | EmilienM: http://paste.openstack.org/show/603026/ should do it | 21:11 |
| panda | EmilienM: http://logs.openstack.org/66/445866/9/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/0f811c3/ | 21:11 |
| panda | EmilienM: http://logs.openstack.org/66/445866/9/check/gate-tripleo-ci-centos-7-nonha-multinode-oooq/0f811c3/logs/subnode-1/var/log/extra/rpm-list.txt.gz | 21:12 |
| panda | openstack-nova-api-14.0.5-0.20170308072737.e2cf6ba.el7.centos.noarch | 21:12 |
| panda | unless of course the rpm list is lying | 21:12 |
| EmilienM | panda: wait how did you test multinode job on newton in tripleo-ci | 21:13 |
| EmilienM | we don't have the layout | 21:13 |
| panda | EmilienM: I forced STABLE_RELEASE in the patch, then removed it | 21:13 |
| EmilienM | STABLE_RELEASE=newton | 21:13 |
| EmilienM | ok I see | 21:13 |
| EmilienM | weird, you have delorean-current on subnode1 | 21:14 |
| EmilienM | let me check if it's really nexton | 21:14 |
| EmilienM | yes it is puppet-tripleo-5.5.1-0.20170314050245.777cff9.el7.centos.noarch | 21:14 |
| EmilienM | bkero: maybe, I don't know; worth trying, please send a patch... | 21:14 |
| EmilienM | I have to leave keyboard in a few min, i'll catch-up later | 21:15 |
| panda | so maybe it's the gate role that is messing the repo ? the change was not tested for gating | 21:15 |
| EmilienM | panda: where is gate role? | 21:15 |
| *** tbonds has joined #tripleo | 21:15 | |
| panda | EmilienM: in quickstart extras | 21:16 |
| EmilienM | ah, I see | 21:16 |
| panda | roles/build-test-packages | 21:16 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: [WIP] Quickstart transition: fallback to old method on stable branches https://review.openstack.org/445461 | 21:17 |
| bkero | patch sending ... slow connection | 21:18 |
| openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci master: oooq quickstart: Add STABLE_RELEASE env variable to subnodes https://review.openstack.org/446746 | 21:19 |
| bkero | EmilienM: ^ | 21:19 |
| EmilienM | I have to go now, please let know in the launchpad bug any progress | 21:19 |
| bkero | ok | 21:19 |
| EmilienM | URL is https://bugs.launchpad.net/tripleo/+bug/1673585 | 21:19 |
| openstack | Launchpad bug 1673585 in tripleo "quickstart: ocata/newton overclouds are deployed with pike repos" [Critical,Triaged] | 21:19 |
| EmilienM | bkero: please submit a dummy patch in THT or puppet-tripleo stable/ocata with Depends-On. | 21:20 |
| bkero | EmilienM: Right, to check scenarios. Will do. | 21:20 |
| *** jcoufal has quit IRC | 21:20 | |
| EmilienM | yeah, gate-tripleo-ci-centos-7-nonha-multinode-oooq | 21:20 |
| EmilienM | if your stuff works, it would be nice to find out why this env was not sent to the subnode | 21:20 |
| * EmilienM bbl | 21:20 | |
| openstackgerrit | Ben Kero proposed openstack/tripleo-heat-templates stable/ocata: TEST CHANGE https://review.openstack.org/446750 | 21:27 |
| bkero | Ok, test change for it: ^ | 21:27 |
| *** egafford has quit IRC | 21:27 | |
| *** fultonj has quit IRC | 21:31 | |
| openstackgerrit | Emilien Macchi proposed openstack/instack-undercloud master: Switch stackrc and undercloud.py to use Keystone v3 https://review.openstack.org/446752 | 21:37 |
| *** funzo has joined #tripleo | 21:38 | |
| *** karimb has joined #tripleo | 21:41 | |
| *** funzo has quit IRC | 21:42 | |
| *** saibarspeis has joined #tripleo | 21:45 | |
| *** ansmith has joined #tripleo | 21:46 | |
| openstackgerrit | Alex Schultz proposed openstack/tripleo-heat-templates master: Re-Add bigswitch agent support https://review.openstack.org/446029 | 21:46 |
| *** dparkes has quit IRC | 21:52 | |
| openstackgerrit | Alan Pevec proposed openstack/tripleo-ui master: Add redux-form dependency https://review.openstack.org/445525 | 21:58 |
| *** tzumainn|bbl is now known as tzumainn | 22:01 | |
| *** jmelvin has quit IRC | 22:02 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-heat-templates master: Updated from global requirements https://review.openstack.org/440124 | 22:02 |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1673585 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1673585 in tripleo "quickstart: ocata/newton overclouds are deployed with pike repos" [Critical,Triaged] | 22:10 |
| *** saibarspeis has quit IRC | 22:10 | |
| *** rhallisey has quit IRC | 22:10 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud master: Add option to configure ceilometer with mongodb backend https://review.openstack.org/446707 | 22:13 |
| bkero | So I did some time measurement for oooq jobs. It' using the old runner scripts, but a dummy test of scenario001 multinode oooq/non-oooq resulted in 1h51m for oooq, 1h4m for non-oooq | 22:16 |
| *** yolanda has quit IRC | 22:16 | |
| bkero | undercloud install took 11m more than before, overcloud deploy took 12m more than usual | 22:17 |
| panda | :/ | 22:20 |
| panda | log collection included ? | 22:21 |
| bkero | panda: see details here: https://trello.com/c/b3dUl5xo/634-q-to-u-find-possible-regressions-in-multinode-oooq-test-job-runtime?menu=filter&filter=label:Multinode-oooq,label:oooq%20phase%201%20transition | 22:21 |
| *** [1]cdearborn has quit IRC | 22:22 | |
| bkero | safe-devstack-vm-gate.sh is also taking 4m as opposed to 14m | 22:23 |
| bkero | Not sure what that's about | 22:23 |
| *** funzo has joined #tripleo | 22:39 | |
| *** gfidente|afk has quit IRC | 22:42 | |
| *** funzo has quit IRC | 22:44 | |
| *** karimb has quit IRC | 22:46 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] Run dib-run-parts out of /tmp https://review.openstack.org/446769 | 22:47 |
| openstackgerrit | Gabriele Cerami proposed openstack/puppet-tripleo master: DONT REVIEW: test failure https://review.openstack.org/442415 | 23:06 |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1673585 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1673585 in tripleo "quickstart: ocata/newton overclouds are deployed with pike repos" [Critical,Triaged] | 23:10 |
| *** pmannidi has joined #tripleo | 23:14 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] Run dib-run-parts out of /tmp https://review.openstack.org/446769 | 23:16 |
| *** rlandy has quit IRC | 23:18 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: [WIP] Run dib-run-parts out of /tmp https://review.openstack.org/446769 | 23:19 |
| *** panda is now known as panda|zZ | 23:21 | |
| *** oaken_chris has joined #tripleo | 23:28 | |
| *** salmankhan has quit IRC | 23:28 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/instack-undercloud master: Add option to configure ceilometer with mongodb backend https://review.openstack.org/446707 | 23:33 |
| *** kbyrne has quit IRC | 23:34 | |
| *** tbonds has quit IRC | 23:36 | |
| *** kbyrne has joined #tripleo | 23:38 | |
| *** funzo has joined #tripleo | 23:39 | |
| *** ansmith has quit IRC | 23:41 | |
| *** funzo has quit IRC | 23:44 | |
| *** marst_ has quit IRC | 23:45 | |
| *** marst has joined #tripleo | 23:55 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!