*** sflanigan has joined #openstack-infra | 00:00 | |
*** sflanigan has joined #openstack-infra | 00:00 | |
*** masayukig_ is now known as masayukig | 00:00 | |
*** sdake has joined #openstack-infra | 00:01 | |
*** dingyichen has joined #openstack-infra | 00:05 | |
*** sdake has quit IRC | 00:08 | |
*** aspiers has joined #openstack-infra | 00:08 | |
*** salv-orlando has quit IRC | 00:15 | |
*** rbuzatu has joined #openstack-infra | 00:23 | |
*** sdake has joined #openstack-infra | 00:24 | |
*** sdake has quit IRC | 00:25 | |
*** rbuzatu_ has joined #openstack-infra | 00:25 | |
*** rbuzatu has quit IRC | 00:27 | |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata https://review.openstack.org/404831 | 00:27 |
---|---|---|
*** wolverineav has joined #openstack-infra | 00:30 | |
*** timrc has quit IRC | 00:32 | |
*** wolverineav has quit IRC | 00:35 | |
*** jlk has quit IRC | 00:35 | |
*** sdake has joined #openstack-infra | 00:38 | |
*** Julien-zte has joined #openstack-infra | 00:39 | |
*** ianychoi has quit IRC | 00:40 | |
*** Julien-zte has quit IRC | 00:40 | |
*** yujunz has joined #openstack-infra | 00:41 | |
*** Julien-zte has joined #openstack-infra | 00:41 | |
*** jamielennox is now known as jamielennox|away | 00:41 | |
*** ianychoi has joined #openstack-infra | 00:44 | |
*** kjorgensen has joined #openstack-infra | 00:54 | |
*** kjorgensen has quit IRC | 00:58 | |
*** jamielennox|away is now known as jamielennox | 00:58 | |
*** sdake_ has joined #openstack-infra | 01:00 | |
*** sdake has quit IRC | 01:01 | |
*** yujunz has quit IRC | 01:02 | |
*** yujunz has joined #openstack-infra | 01:02 | |
*** Julien-zte has quit IRC | 01:05 | |
*** jog0 has joined #openstack-infra | 01:05 | |
*** jog0 has quit IRC | 01:05 | |
*** jog0 has joined #openstack-infra | 01:05 | |
*** yujunz has quit IRC | 01:06 | |
*** Julien-zte has joined #openstack-infra | 01:06 | |
*** Julien-zte has quit IRC | 01:06 | |
*** Julien-zte has joined #openstack-infra | 01:08 | |
*** Julien-zte has quit IRC | 01:08 | |
*** yujunz has joined #openstack-infra | 01:08 | |
*** Julien-zte has joined #openstack-infra | 01:09 | |
*** yujunz has quit IRC | 01:09 | |
*** Julien-zte has quit IRC | 01:10 | |
*** Julien-zte has joined #openstack-infra | 01:11 | |
*** yujunz has joined #openstack-infra | 01:11 | |
*** Julien-zte has quit IRC | 01:12 | |
*** dirk has quit IRC | 01:12 | |
*** dougwig has quit IRC | 01:12 | |
*** rattboi has quit IRC | 01:12 | |
*** fbo has quit IRC | 01:12 | |
*** cschwede has quit IRC | 01:12 | |
*** mattymo has quit IRC | 01:12 | |
*** mrunge has quit IRC | 01:12 | |
*** jcook has quit IRC | 01:12 | |
*** llu has quit IRC | 01:12 | |
*** aarefiev_afk has quit IRC | 01:12 | |
*** erlon has quit IRC | 01:12 | |
*** jesusaur has quit IRC | 01:12 | |
*** rosmaita has quit IRC | 01:12 | |
*** med_ has quit IRC | 01:12 | |
*** tobiash_ has quit IRC | 01:12 | |
*** Qiming has quit IRC | 01:12 | |
*** skraynev has quit IRC | 01:12 | |
*** kambiz has quit IRC | 01:12 | |
*** mattfarina has quit IRC | 01:12 | |
*** comstud has quit IRC | 01:12 | |
*** jak-jak has quit IRC | 01:12 | |
*** kfox1111 has quit IRC | 01:12 | |
*** russellb has quit IRC | 01:12 | |
*** ryotagami has quit IRC | 01:12 | |
*** morgabra has quit IRC | 01:12 | |
*** patrickeast has quit IRC | 01:12 | |
*** lewo has quit IRC | 01:12 | |
*** calebb has quit IRC | 01:12 | |
*** mcarden has quit IRC | 01:12 | |
*** asaprykin has quit IRC | 01:12 | |
*** jbryce has quit IRC | 01:12 | |
*** mgagne has quit IRC | 01:12 | |
*** vkmc has quit IRC | 01:12 | |
*** mordred has quit IRC | 01:12 | |
*** mattoliverau has quit IRC | 01:12 | |
*** khappone_ has quit IRC | 01:12 | |
*** DinaBelova has quit IRC | 01:12 | |
*** jhesketh has quit IRC | 01:12 | |
*** dims has quit IRC | 01:12 | |
*** xhku has quit IRC | 01:12 | |
*** csmart has quit IRC | 01:12 | |
*** darrenc has quit IRC | 01:12 | |
*** Daviey has quit IRC | 01:12 | |
*** olaph has quit IRC | 01:12 | |
*** yanyanhu has joined #openstack-infra | 01:12 | |
*** kfox1111 has joined #openstack-infra | 01:12 | |
*** csmart has joined #openstack-infra | 01:12 | |
*** matt6434 has joined #openstack-infra | 01:12 | |
*** rosmaita has joined #openstack-infra | 01:12 | |
*** morgabra_ has joined #openstack-infra | 01:12 | |
*** Daviey has joined #openstack-infra | 01:12 | |
*** cschwede has joined #openstack-infra | 01:12 | |
*** xhku has joined #openstack-infra | 01:12 | |
*** med_ has joined #openstack-infra | 01:12 | |
*** mordred has joined #openstack-infra | 01:12 | |
*** Julien-zte has joined #openstack-infra | 01:12 | |
*** darrenc_ has joined #openstack-infra | 01:12 | |
*** lewo_ has joined #openstack-infra | 01:12 | |
*** skraynev has joined #openstack-infra | 01:12 | |
*** comstud has joined #openstack-infra | 01:12 | |
*** jbryce_ has joined #openstack-infra | 01:12 | |
*** calebb has joined #openstack-infra | 01:12 | |
*** DinaBelova has joined #openstack-infra | 01:12 | |
*** olaph has joined #openstack-infra | 01:13 | |
*** russellb has joined #openstack-infra | 01:13 | |
*** med_ is now known as Guest34220 | 01:13 | |
*** mattymo has joined #openstack-infra | 01:13 | |
*** mrunge has joined #openstack-infra | 01:13 | |
*** kambiz has joined #openstack-infra | 01:13 | |
*** yujunz has quit IRC | 01:13 | |
*** jbryce_ is now known as jbryce | 01:13 | |
*** lewo_ is now known as lewo | 01:13 | |
*** aarefiev_afk has joined #openstack-infra | 01:13 | |
*** jhesketh has joined #openstack-infra | 01:13 | |
*** jesusaur has joined #openstack-infra | 01:13 | |
*** rattboi has joined #openstack-infra | 01:13 | |
*** ryotagami has joined #openstack-infra | 01:13 | |
*** khappone has joined #openstack-infra | 01:13 | |
*** mcarden has joined #openstack-infra | 01:13 | |
*** vkmc has joined #openstack-infra | 01:13 | |
*** vkmc has quit IRC | 01:13 | |
*** vkmc has joined #openstack-infra | 01:13 | |
*** Guest96631 has joined #openstack-infra | 01:13 | |
*** tobiash has joined #openstack-infra | 01:13 | |
*** jak-jak has joined #openstack-infra | 01:13 | |
*** fbo has joined #openstack-infra | 01:13 | |
*** darrenc_ is now known as darrenc | 01:14 | |
*** Qiming has joined #openstack-infra | 01:14 | |
*** dims has joined #openstack-infra | 01:14 | |
*** jcook has joined #openstack-infra | 01:15 | |
*** llu has joined #openstack-infra | 01:15 | |
*** dougwig has joined #openstack-infra | 01:15 | |
*** Julien-zte has quit IRC | 01:15 | |
*** asaprykin has joined #openstack-infra | 01:16 | |
*** Julien-zte has joined #openstack-infra | 01:16 | |
*** erlon has joined #openstack-infra | 01:16 | |
*** mriedem has quit IRC | 01:16 | |
*** patrickeast has joined #openstack-infra | 01:17 | |
*** Julien-zte has quit IRC | 01:17 | |
*** mattfarina has joined #openstack-infra | 01:18 | |
*** dirk has joined #openstack-infra | 01:18 | |
*** timrc has joined #openstack-infra | 01:19 | |
*** Julien-zte has joined #openstack-infra | 01:19 | |
*** yujunz has joined #openstack-infra | 01:19 | |
*** Julien-zte has quit IRC | 01:20 | |
*** Julien-zte has joined #openstack-infra | 01:20 | |
*** yujunz-zte has joined #openstack-infra | 01:21 | |
*** Julien-zte has quit IRC | 01:21 | |
*** liujiong has joined #openstack-infra | 01:21 | |
*** Julien-zte has joined #openstack-infra | 01:22 | |
*** yujunz has quit IRC | 01:22 | |
*** Julien-zte has quit IRC | 01:22 | |
*** yujunz-zte has quit IRC | 01:22 | |
*** yujunz_ has joined #openstack-infra | 01:22 | |
*** Julien-zte has joined #openstack-infra | 01:23 | |
*** Mmike has quit IRC | 01:23 | |
*** xgerman has quit IRC | 01:23 | |
*** sweston has quit IRC | 01:23 | |
*** Hunner has quit IRC | 01:23 | |
*** uberjay has quit IRC | 01:23 | |
*** bmjen has quit IRC | 01:23 | |
*** timrc_ has quit IRC | 01:23 | |
*** briancurtin has quit IRC | 01:23 | |
*** johnsom has quit IRC | 01:23 | |
*** ogelbukh has quit IRC | 01:23 | |
*** YorikSar has quit IRC | 01:23 | |
*** jeckersb has quit IRC | 01:23 | |
*** ansiwen has quit IRC | 01:23 | |
*** dhellmann has quit IRC | 01:23 | |
*** szaher has quit IRC | 01:23 | |
*** dangers_away has quit IRC | 01:23 | |
*** akscram has quit IRC | 01:23 | |
*** davidlenwell has quit IRC | 01:23 | |
*** warpc has quit IRC | 01:23 | |
*** edwarnicke has quit IRC | 01:23 | |
*** knikolla has quit IRC | 01:23 | |
*** jistr has quit IRC | 01:23 | |
*** morgan has quit IRC | 01:23 | |
*** lbragstad has quit IRC | 01:23 | |
*** lin_yang has quit IRC | 01:23 | |
*** berendt has quit IRC | 01:23 | |
*** sridhar_ram has quit IRC | 01:23 | |
*** dasm has quit IRC | 01:23 | |
*** JayF has quit IRC | 01:23 | |
*** zigo has quit IRC | 01:23 | |
*** michaelxin has quit IRC | 01:23 | |
*** lcastell has quit IRC | 01:23 | |
*** antwash has quit IRC | 01:23 | |
*** panda|pto has quit IRC | 01:23 | |
*** jmccrory has quit IRC | 01:23 | |
*** jpmaxman has quit IRC | 01:23 | |
*** kevinshort has quit IRC | 01:23 | |
*** dtroyer has quit IRC | 01:23 | |
*** amit213 has quit IRC | 01:23 | |
*** fmccrthy has quit IRC | 01:23 | |
*** auggy has quit IRC | 01:23 | |
*** igorbelikov has quit IRC | 01:23 | |
*** sslypushenko_ has quit IRC | 01:23 | |
*** niedbalski has quit IRC | 01:23 | |
*** melwitt has quit IRC | 01:23 | |
*** verdurin has quit IRC | 01:23 | |
*** zerick has quit IRC | 01:23 | |
*** redrobot has quit IRC | 01:23 | |
*** hemna has quit IRC | 01:23 | |
*** yujunz_ has quit IRC | 01:23 | |
*** niedbalski has joined #openstack-infra | 01:23 | |
*** bmjen has joined #openstack-infra | 01:23 | |
*** zigo has joined #openstack-infra | 01:23 | |
*** lbragstad_ has joined #openstack-infra | 01:23 | |
*** jmccrory_ has joined #openstack-infra | 01:23 | |
*** YorikSar has joined #openstack-infra | 01:23 | |
*** melwitt has joined #openstack-infra | 01:23 | |
*** hemna has joined #openstack-infra | 01:23 | |
*** zerick has joined #openstack-infra | 01:23 | |
*** dangers_away has joined #openstack-infra | 01:23 | |
*** dasm has joined #openstack-infra | 01:23 | |
*** panda|pto has joined #openstack-infra | 01:24 | |
*** jeckersb has joined #openstack-infra | 01:24 | |
*** lcastell has joined #openstack-infra | 01:24 | |
*** akscram has joined #openstack-infra | 01:24 | |
*** timrchavez_ has joined #openstack-infra | 01:24 | |
*** melwitt is now known as Guest86619 | 01:24 | |
*** JayF has joined #openstack-infra | 01:24 | |
*** antwash has joined #openstack-infra | 01:24 | |
*** uberjay has joined #openstack-infra | 01:24 | |
*** Hunner has joined #openstack-infra | 01:24 | |
*** Hunner has quit IRC | 01:24 | |
*** Hunner has joined #openstack-infra | 01:24 | |
*** yujunz has joined #openstack-infra | 01:24 | |
*** dasm is now known as Guest3684 | 01:24 | |
*** verdurin has joined #openstack-infra | 01:24 | |
*** redrobot has joined #openstack-infra | 01:24 | |
*** Julien-zte has quit IRC | 01:24 | |
*** redrobot is now known as Guest59792 | 01:24 | |
*** jistr has joined #openstack-infra | 01:24 | |
*** ansiwen has joined #openstack-infra | 01:24 | |
*** Mmike has joined #openstack-infra | 01:25 | |
*** Julien-zte has joined #openstack-infra | 01:25 | |
*** jmccrory_ is now known as jmccrory | 01:25 | |
*** kevinshort has joined #openstack-infra | 01:25 | |
*** dhellmann has joined #openstack-infra | 01:25 | |
*** szaher has joined #openstack-infra | 01:25 | |
*** Julien-zte has quit IRC | 01:25 | |
*** Julien-zte has joined #openstack-infra | 01:26 | |
*** edwarnicke has joined #openstack-infra | 01:26 | |
*** warpc has joined #openstack-infra | 01:26 | |
*** Julien-zte has quit IRC | 01:26 | |
*** jlk has joined #openstack-infra | 01:26 | |
*** jlk has quit IRC | 01:26 | |
*** jlk has joined #openstack-infra | 01:26 | |
*** lin_yang has joined #openstack-infra | 01:26 | |
*** dtroyer has joined #openstack-infra | 01:28 | |
*** Julien-zte has joined #openstack-infra | 01:28 | |
*** jpmaxman has joined #openstack-infra | 01:28 | |
*** Julien-zte has quit IRC | 01:28 | |
*** briancurtin has joined #openstack-infra | 01:28 | |
*** auggy has joined #openstack-infra | 01:28 | |
*** igorbelikov has joined #openstack-infra | 01:28 | |
*** Julien-zte has joined #openstack-infra | 01:29 | |
*** fmccrthy has joined #openstack-infra | 01:29 | |
*** ogelbukh has joined #openstack-infra | 01:29 | |
*** sweston has joined #openstack-infra | 01:29 | |
*** davidlenwell has joined #openstack-infra | 01:29 | |
*** sslypushenko_ has joined #openstack-infra | 01:29 | |
*** amit213 has joined #openstack-infra | 01:29 | |
*** Julien-zte has quit IRC | 01:30 | |
*** Julien-zte has joined #openstack-infra | 01:32 | |
*** rkukura has joined #openstack-infra | 01:32 | |
*** Julien-zte has quit IRC | 01:32 | |
*** xgerman has joined #openstack-infra | 01:33 | |
*** Julien-zte has joined #openstack-infra | 01:33 | |
*** Julien-zte has quit IRC | 01:34 | |
*** Julien-zte has joined #openstack-infra | 01:34 | |
*** michaelxin has joined #openstack-infra | 01:35 | |
*** tuanluong has joined #openstack-infra | 01:35 | |
*** morgan has joined #openstack-infra | 01:36 | |
*** Julien-zte has quit IRC | 01:36 | |
*** Julien-zte has joined #openstack-infra | 01:37 | |
*** ihrachys has quit IRC | 01:38 | |
*** berendt has joined #openstack-infra | 01:39 | |
*** johnsom has joined #openstack-infra | 01:39 | |
*** sridhar_ram has joined #openstack-infra | 01:39 | |
*** thorst has joined #openstack-infra | 01:39 | |
*** ameade has quit IRC | 01:42 | |
*** dtroyer has quit IRC | 01:43 | |
*** Julien-zte has quit IRC | 01:43 | |
*** ameade has joined #openstack-infra | 01:43 | |
*** thorst has quit IRC | 01:44 | |
*** Julien-zte has joined #openstack-infra | 01:44 | |
*** dtroyer has joined #openstack-infra | 01:45 | |
*** Julien-zte has quit IRC | 01:46 | |
*** tomhambleton has quit IRC | 01:46 | |
*** salv-orlando has joined #openstack-infra | 01:46 | |
*** Julien-zte has joined #openstack-infra | 01:46 | |
*** tomhambleton has joined #openstack-infra | 01:47 | |
*** matt6434 is now known as mattoliverau | 01:48 | |
*** salv-orlando has quit IRC | 01:50 | |
*** lewo has quit IRC | 01:51 | |
*** lewo has joined #openstack-infra | 01:51 | |
*** sslypushenko_ has quit IRC | 01:54 | |
*** sslypushenko_ has joined #openstack-infra | 01:55 | |
*** thorst has joined #openstack-infra | 01:56 | |
*** ildikov has quit IRC | 01:57 | |
*** ildikov has joined #openstack-infra | 02:00 | |
openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/devstack-gate: Remove USE_PYTHON3 usage https://review.openstack.org/417720 | 02:03 |
*** Julien-zte has quit IRC | 02:04 | |
*** Julien-zte has joined #openstack-infra | 02:05 | |
*** thorst has quit IRC | 02:09 | |
*** ihrachys has joined #openstack-infra | 02:13 | |
*** cody-somerville has quit IRC | 02:17 | |
*** booleanfour has quit IRC | 02:17 | |
*** hyakuhei has quit IRC | 02:19 | |
*** xgerman has quit IRC | 02:20 | |
*** hyakuhei has joined #openstack-infra | 02:22 | |
*** csatari has quit IRC | 02:28 | |
*** csatari has joined #openstack-infra | 02:28 | |
*** liusheng has joined #openstack-infra | 02:32 | |
*** Julien-zte has quit IRC | 02:37 | |
*** Julien-zte has joined #openstack-infra | 02:38 | |
*** yujunz has quit IRC | 02:38 | |
*** yujunz has joined #openstack-infra | 02:39 | |
*** sdake_ has quit IRC | 02:40 | |
*** makowals has quit IRC | 02:41 | |
*** yujunz has quit IRC | 02:41 | |
*** dave-mccowan has joined #openstack-infra | 02:41 | |
*** yujunz has joined #openstack-infra | 02:42 | |
*** makowals has joined #openstack-infra | 02:42 | |
*** samueldmq has quit IRC | 02:42 | |
*** ashtokolov has quit IRC | 02:42 | |
*** aglarendil has quit IRC | 02:42 | |
*** jraim has quit IRC | 02:42 | |
*** larainema has quit IRC | 02:42 | |
*** skath has quit IRC | 02:42 | |
*** fkautz has quit IRC | 02:42 | |
*** dham1 has quit IRC | 02:42 | |
*** erlon has quit IRC | 02:42 | |
*** samueldmq has joined #openstack-infra | 02:42 | |
*** zigo has quit IRC | 02:43 | |
*** puiterwijk|cld has quit IRC | 02:43 | |
*** fkautz has joined #openstack-infra | 02:43 | |
*** erlon has joined #openstack-infra | 02:43 | |
*** larainema has joined #openstack-infra | 02:43 | |
*** xnox has quit IRC | 02:43 | |
*** sdake has joined #openstack-infra | 02:44 | |
*** khappone_ has joined #openstack-infra | 02:44 | |
*** khappone has quit IRC | 02:44 | |
*** jroll has quit IRC | 02:44 | |
*** alexm2 has quit IRC | 02:44 | |
*** adam_g has quit IRC | 02:44 | |
*** lVathan[m] has quit IRC | 02:44 | |
*** calebb has quit IRC | 02:45 | |
*** adam_g has joined #openstack-infra | 02:45 | |
*** alexm2 has joined #openstack-infra | 02:45 | |
*** jroll has joined #openstack-infra | 02:45 | |
*** xnox has joined #openstack-infra | 02:45 | |
*** calebb has joined #openstack-infra | 02:47 | |
*** dham1 has joined #openstack-infra | 02:47 | |
*** salv-orlando has joined #openstack-infra | 02:47 | |
*** lVathan[m] has joined #openstack-infra | 02:48 | |
*** zigo has joined #openstack-infra | 02:48 | |
*** jraim has joined #openstack-infra | 02:49 | |
*** ashtokolov has joined #openstack-infra | 02:49 | |
*** skath has joined #openstack-infra | 02:50 | |
*** gildub has quit IRC | 02:51 | |
*** salv-orlando has quit IRC | 02:51 | |
*** aglarendil_ has joined #openstack-infra | 02:52 | |
*** david-lyle has quit IRC | 02:55 | |
*** claudiub has quit IRC | 02:57 | |
*** ihrachys has quit IRC | 02:59 | |
jianghuaw | hi mordred. | 02:59 |
*** ihrachys has joined #openstack-infra | 02:59 | |
jianghuaw | I moved the network setup from nodepool.yaml to clouds.yaml. But I met the following errors when boot server: | 03:00 |
jianghuaw | penStackCloudException: Error in creating instance (Inner Exception: Multiple possible networks found, use a Network ID to be more specific. (HTTP 409) (Request-ID: req-fd5530b3-94df-4b04-a54f-ec55f9b4d2b1)) | 03:00 |
*** EricGonc_ has joined #openstack-infra | 03:00 | |
jianghuaw | see the configuration setup at: http://paste.openstack.org/show/594249/ | 03:01 |
jianghuaw | It looks like nodepool doesn't use the network setup from clouds.yaml. | 03:01 |
*** andymccr has quit IRC | 03:01 | |
*** andymccr has joined #openstack-infra | 03:02 | |
*** EricGonczer_ has quit IRC | 03:03 | |
jianghuaw | mordred, are you around? | 03:03 |
*** dtroyer has quit IRC | 03:03 | |
*** erikmwilson has quit IRC | 03:03 | |
openstackgerrit | rajiv proposed openstack-infra/subunit2sql: H402 hacking have been deprecated https://review.openstack.org/417727 | 03:04 |
*** dtroyer has joined #openstack-infra | 03:06 | |
*** EricGonc_ has quit IRC | 03:07 | |
*** saibarspeis has quit IRC | 03:07 | |
*** xarses has joined #openstack-infra | 03:07 | |
*** erikmwilson has joined #openstack-infra | 03:07 | |
*** saibarspeis has joined #openstack-infra | 03:08 | |
*** xarses_ has joined #openstack-infra | 03:10 | |
*** ramishra has quit IRC | 03:10 | |
*** xarses_ has quit IRC | 03:10 | |
*** xarses_ has joined #openstack-infra | 03:11 | |
*** ramishra has joined #openstack-infra | 03:12 | |
*** gongysh has joined #openstack-infra | 03:13 | |
*** xarses has quit IRC | 03:13 | |
*** yanyanhu has quit IRC | 03:13 | |
*** hongbin has joined #openstack-infra | 03:15 | |
*** gildub has joined #openstack-infra | 03:16 | |
*** gongysh has quit IRC | 03:17 | |
*** yanyanhu has joined #openstack-infra | 03:18 | |
*** Jeffrey4l_ has quit IRC | 03:18 | |
*** dimtruck has quit IRC | 03:20 | |
openstackgerrit | ChangBo Guo(gcb) proposed openstack-infra/project-config: Add functional-py35 non-voting job for Nova https://review.openstack.org/410105 | 03:23 |
*** dimtruck has joined #openstack-infra | 03:23 | |
*** yujunz has quit IRC | 03:23 | |
*** yujunz has joined #openstack-infra | 03:24 | |
openstackgerrit | Hongbin Lu proposed openstack-infra/project-config: Fuxi: Add python35 non-voting jobs https://review.openstack.org/417734 | 03:25 |
*** lewo has quit IRC | 03:27 | |
*** yujunz has quit IRC | 03:27 | |
*** lewo has joined #openstack-infra | 03:27 | |
*** Guest86619 is now known as melwitt | 03:27 | |
mordred | jianghuaw: can you try again leaving what you've put in clouds.yaml (that looks great) but also uncomment lines 4-6 ? | 03:28 |
mordred | jianghuaw: I need to write better docs on the difference between these two things | 03:29 |
mordred | I also need to add one more network setting to clouds.yaml I think ... | 03:29 |
mordred | but I'll have to do that tomorrow | 03:29 |
*** yujunz has joined #openstack-infra | 03:30 | |
jianghuaw | mordred, the error is: | 03:31 |
jianghuaw | OpenStackCloudException: unable to create floating IP for net None: Unable to find an external network in this cloud which makes getting a floating IP impossible | 03:31 |
mordred | jianghuaw: ok. you may need to keep doing your patch for now - I'm not smart enough this late to figure out a fix - but I may want to ask you for some info tomorrow ... | 03:34 |
*** gongysh has joined #openstack-infra | 03:34 | |
jianghuaw | mordred, thanks and Sorry for having bothered you so late for you. | 03:35 |
*** Ng has quit IRC | 03:36 | |
*** yujunz has quit IRC | 03:37 | |
*** Ng has joined #openstack-infra | 03:37 | |
*** yujunz has joined #openstack-infra | 03:37 | |
*** askb has quit IRC | 03:38 | |
*** rbuzatu_ has quit IRC | 03:41 | |
*** askb has joined #openstack-infra | 03:42 | |
*** lewo has quit IRC | 03:44 | |
*** lewo has joined #openstack-infra | 03:47 | |
*** mariojv has quit IRC | 03:47 | |
*** salv-orlando has joined #openstack-infra | 03:48 | |
*** mariojv has joined #openstack-infra | 03:48 | |
*** EricGonczer_ has joined #openstack-infra | 03:51 | |
*** salv-orlando has quit IRC | 03:52 | |
*** yamahata has joined #openstack-infra | 03:56 | |
*** dimtruck is now known as zz_dimtruck | 03:58 | |
*** xarses_ has quit IRC | 04:00 | |
*** links has joined #openstack-infra | 04:02 | |
*** yujunz is now known as yujunz[away] | 04:03 | |
openstackgerrit | Hongbin Lu proposed openstack-infra/project-config: Fuxi: Add python35 non-voting jobs https://review.openstack.org/417734 | 04:04 |
*** yujunz[away] has quit IRC | 04:05 | |
*** kjorgensen has joined #openstack-infra | 04:05 | |
*** kjorgens_ has joined #openstack-infra | 04:07 | |
*** EricGonczer_ has quit IRC | 04:08 | |
*** kjorgensen has quit IRC | 04:10 | |
*** psachin has joined #openstack-infra | 04:13 | |
*** xarses_ has joined #openstack-infra | 04:16 | |
*** xgerman has joined #openstack-infra | 04:17 | |
*** andreww has joined #openstack-infra | 04:17 | |
*** andreww has quit IRC | 04:18 | |
*** andreww has joined #openstack-infra | 04:18 | |
*** rkukura has quit IRC | 04:21 | |
*** xarses_ has quit IRC | 04:21 | |
*** sdake has quit IRC | 04:25 | |
*** dave-mccowan has quit IRC | 04:28 | |
*** zul has quit IRC | 04:37 | |
openstackgerrit | Hongbin Lu proposed openstack-infra/project-config: Fuxi: Add python35 dsvm non-voting jobs https://review.openstack.org/417741 | 04:38 |
*** kjorgens_ has quit IRC | 04:39 | |
*** puiterwijk|cld has joined #openstack-infra | 04:40 | |
*** rbuzatu has joined #openstack-infra | 04:42 | |
*** yamahata has quit IRC | 04:45 | |
*** cloudnull has quit IRC | 04:45 | |
*** rbuzatu has quit IRC | 04:46 | |
*** cloudnull has joined #openstack-infra | 04:48 | |
*** salv-orlando has joined #openstack-infra | 04:49 | |
*** hongbin has quit IRC | 04:50 | |
*** salv-orlando has quit IRC | 04:54 | |
*** makowals has quit IRC | 05:00 | |
*** ihrachys has quit IRC | 05:00 | |
*** bhavik1 has joined #openstack-infra | 05:01 | |
*** ihrachys has joined #openstack-infra | 05:01 | |
*** spligak has quit IRC | 05:01 | |
*** kjorgensen has joined #openstack-infra | 05:03 | |
*** bhavik1 has quit IRC | 05:03 | |
*** ijw has joined #openstack-infra | 05:07 | |
*** kjorgensen has quit IRC | 05:07 | |
*** sdake has joined #openstack-infra | 05:12 | |
*** adriant has quit IRC | 05:12 | |
*** claudiub has joined #openstack-infra | 05:13 | |
*** rbuzatu has joined #openstack-infra | 05:21 | |
openstackgerrit | Hongbin Lu proposed openstack-infra/project-config: Fuxi: Add python35 dsvm non-voting jobs https://review.openstack.org/417741 | 05:22 |
*** rbuzatu has quit IRC | 05:26 | |
*** nadya has joined #openstack-infra | 05:32 | |
*** sdake has quit IRC | 05:34 | |
*** ihrachys has quit IRC | 05:36 | |
*** aviau has quit IRC | 05:37 | |
*** aviau has joined #openstack-infra | 05:37 | |
*** yujunz has joined #openstack-infra | 05:38 | |
*** thorst has joined #openstack-infra | 05:38 | |
*** adrian_otto has joined #openstack-infra | 05:40 | |
*** thorst has quit IRC | 05:43 | |
*** nadya has quit IRC | 05:49 | |
*** adrian_otto has quit IRC | 05:53 | |
*** tnovacik has joined #openstack-infra | 06:02 | |
*** flepied has quit IRC | 06:03 | |
*** nadya has joined #openstack-infra | 06:07 | |
*** nadya has quit IRC | 06:08 | |
*** flepied has joined #openstack-infra | 06:17 | |
*** itisha has quit IRC | 06:22 | |
*** rbuzatu has joined #openstack-infra | 06:22 | |
*** rbuzatu has quit IRC | 06:27 | |
*** salv-orlando has joined #openstack-infra | 06:27 | |
*** ediardo has quit IRC | 06:32 | |
*** ediardo has joined #openstack-infra | 06:32 | |
*** flepied has quit IRC | 06:33 | |
*** booleanfour has joined #openstack-infra | 06:40 | |
*** Guest99613 has quit IRC | 06:42 | |
AJaeger | jhesketh, ianw : Could either of you +A 417679, please? Let's merge it to fix docs publishing to the AFS site. | 06:48 |
jhesketh | AJaeger: I'm out at the moment sorry. Can take a look later tonight if ianw doesn't beat me | 06:50 |
*** gildub has quit IRC | 06:53 | |
AJaeger | jhesketh: thanks | 06:54 |
*** AJaeger has quit IRC | 06:54 | |
*** ijw_ has joined #openstack-infra | 06:55 | |
*** makowals has joined #openstack-infra | 06:55 | |
*** ijw has quit IRC | 06:58 | |
*** AJaeger has joined #openstack-infra | 07:00 | |
*** spligak has joined #openstack-infra | 07:02 | |
*** pgadiya has joined #openstack-infra | 07:03 | |
*** tnovacik has quit IRC | 07:04 | |
*** bhavik1 has joined #openstack-infra | 07:04 | |
*** florianf has joined #openstack-infra | 07:05 | |
*** rcernin has joined #openstack-infra | 07:08 | |
*** tesseract has joined #openstack-infra | 07:12 | |
*** cody-somerville has joined #openstack-infra | 07:15 | |
*** cody-somerville has quit IRC | 07:15 | |
*** cody-somerville has joined #openstack-infra | 07:15 | |
openstackgerrit | Julia Varlamova proposed openstack-infra/devstack-gate: Add MULTI_KEYSTONE flag and new role https://review.openstack.org/394895 | 07:17 |
*** yujunz is now known as yujunz[away] | 07:23 | |
*** yujunz[away] is now known as yujunz | 07:23 | |
*** rbuzatu has joined #openstack-infra | 07:23 | |
*** yujunz is now known as yujunz[away] | 07:24 | |
*** yujunz[away] is now known as yujunz | 07:24 | |
*** yujunz is now known as yujunz[away] | 07:24 | |
*** yujunz[away] is now known as yujunz | 07:25 | |
*** nherciu has joined #openstack-infra | 07:29 | |
*** armax has joined #openstack-infra | 07:33 | |
*** nherciu_ has joined #openstack-infra | 07:35 | |
*** markus_z has joined #openstack-infra | 07:36 | |
AJaeger | morning yolanda, could you +2A 417679, please? Let's merge it to fix docs publishing to the AFS site. | 07:37 |
yolanda | hi, good morning | 07:37 |
yolanda | sure | 07:37 |
AJaeger | thanks | 07:37 |
*** rbuzatu has quit IRC | 07:38 | |
*** nherciu has quit IRC | 07:38 | |
*** thorst has joined #openstack-infra | 07:39 | |
*** pcaruana has joined #openstack-infra | 07:41 | |
openstackgerrit | Merged openstack-infra/project-config: Fuxi: Add python35 non-voting jobs https://review.openstack.org/417734 | 07:41 |
openstackgerrit | Merged openstack-infra/system-config: Publish to read-write docs volume https://review.openstack.org/417679 | 07:43 |
*** hashar has joined #openstack-infra | 07:43 | |
openstackgerrit | Merged openstack-infra/project-config: Rename usage of USE_PYTHON3 to DEVSTACK_GATE_USE_PYTHON3 https://review.openstack.org/417456 | 07:43 |
*** thorst has quit IRC | 07:43 | |
*** kaisers has left #openstack-infra | 07:44 | |
openstackgerrit | Yuval Brik proposed openstack-infra/project-config: kuryr-kubernetes: add dragonflow to PROJECTS https://review.openstack.org/417768 | 07:44 |
openstackgerrit | Merged openstack-infra/project-config: glance rally test with python3.5 https://review.openstack.org/417228 | 07:44 |
openstackgerrit | Merged openstack-infra/project-config: Enable Python3x DSVM in Octavia deliverables https://review.openstack.org/417120 | 07:46 |
openstackgerrit | Merged openstack-infra/project-config: Enable registry upload on successfull merge https://review.openstack.org/417460 | 07:47 |
openstackgerrit | Merged openstack-infra/project-config: Add ansible-role-sudoers project https://review.openstack.org/417472 | 07:48 |
*** erikmwilson has quit IRC | 07:48 | |
*** dtardivel has joined #openstack-infra | 07:49 | |
openstackgerrit | Merged openstack-infra/project-config: Add experimental python3 dsvm job for ironic https://review.openstack.org/417202 | 07:49 |
*** erikmwilson has joined #openstack-infra | 07:50 | |
*** flepied has joined #openstack-infra | 07:51 | |
openstackgerrit | Merged openstack-infra/project-config: Make networking-cisco OpenStack version tests voting https://review.openstack.org/407546 | 07:51 |
*** andreas_s has joined #openstack-infra | 07:54 | |
AJaeger | yolanda: please also review https://review.openstack.org/#/c/417630 and https://review.openstack.org/#/c/414714/ https://review.openstack.org/#/c/416919/ https://review.openstack.org/#/c/417110/ https://review.openstack.org/#/c/417464/ if you have time. | 07:55 |
openstackgerrit | Yuval Brik proposed openstack-infra/project-config: kuryr-kubernetes: add dragonflow to PROJECTS https://review.openstack.org/417768 | 07:55 |
*** thorst has joined #openstack-infra | 08:00 | |
*** salv-orlando has quit IRC | 08:01 | |
*** wolverineav has joined #openstack-infra | 08:02 | |
*** Hal has joined #openstack-infra | 08:03 | |
*** d0ugal_ has quit IRC | 08:03 | |
*** Hal is now known as Guest34528 | 08:03 | |
*** d0ugal has joined #openstack-infra | 08:03 | |
*** d0ugal has quit IRC | 08:03 | |
*** d0ugal has joined #openstack-infra | 08:03 | |
*** bhavik1 has quit IRC | 08:03 | |
*** thorst has quit IRC | 08:04 | |
*** ccamacho has joined #openstack-infra | 08:05 | |
*** wolverineav has quit IRC | 08:06 | |
*** cody-somerville has quit IRC | 08:07 | |
ianw | thanks yolanda :) sorry just checking in quickly | 08:08 |
*** nmagnezi has joined #openstack-infra | 08:09 | |
*** gouthamr has quit IRC | 08:11 | |
openstackgerrit | Dougal Matthews proposed openstack-infra/tripleo-ci: Use a more specific feed for my blog https://review.openstack.org/411687 | 08:14 |
openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/417775 | 08:16 |
*** ralonsoh has joined #openstack-infra | 08:18 | |
*** openstackgerrit has quit IRC | 08:18 | |
*** nadya has joined #openstack-infra | 08:24 | |
*** mptacekx has joined #openstack-infra | 08:25 | |
*** nadya has quit IRC | 08:25 | |
*** openstackgerrit has joined #openstack-infra | 08:28 | |
openstackgerrit | Fedor Zhadaev proposed openstack-infra/project-config: Add fuel-plugin-congress https://review.openstack.org/415126 | 08:28 |
*** pgadiya has quit IRC | 08:28 | |
*** panda|pto is now known as panda | 08:28 | |
*** ijw_ has quit IRC | 08:29 | |
*** ijw has joined #openstack-infra | 08:30 | |
openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci: Remove the current CI matrix from tripleo-ci https://review.openstack.org/409697 | 08:33 |
*** rbuzatu has joined #openstack-infra | 08:34 | |
openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/417775 | 08:35 |
*** rbuzatu has quit IRC | 08:38 | |
*** nadya has joined #openstack-infra | 08:43 | |
*** pgadiya has joined #openstack-infra | 08:44 | |
*** jpich has joined #openstack-infra | 08:47 | |
*** dingyichen has quit IRC | 08:50 | |
*** Mmike has quit IRC | 08:52 | |
*** Mmike has joined #openstack-infra | 08:52 | |
*** yujunz is now known as yujunz[away] | 08:53 | |
*** salv-orlando has joined #openstack-infra | 08:53 | |
*** yujunz[away] is now known as yujunz | 08:54 | |
*** yujunz is now known as yujunz[away] | 08:54 | |
*** yujunz[away] is now known as yujunz | 08:54 | |
*** flaper87 has joined #openstack-infra | 08:54 | |
*** flaper87 has quit IRC | 08:55 | |
*** flaper87 has joined #openstack-infra | 08:55 | |
*** yujunz is now known as yujunz[away] | 08:55 | |
*** yujunz[away] is now known as yujunz | 08:55 | |
*** ekuris has joined #openstack-infra | 08:55 | |
*** yujunz is now known as yujunz[away] | 08:55 | |
*** yujunz[away] is now known as yujunz | 08:56 | |
*** yujunz is now known as yujunz[away] | 08:57 | |
*** zzzeek has quit IRC | 09:00 | |
*** zzzeek has joined #openstack-infra | 09:00 | |
*** yujunz[away] is now known as yujunz | 09:00 | |
*** yujunz is now known as yujunz[away] | 09:01 | |
*** umeshksingla has joined #openstack-infra | 09:01 | |
*** yujunz[away] is now known as yujunz | 09:01 | |
*** yujunz is now known as yujunz[away] | 09:01 | |
*** yujunz[away] is now known as yujunz | 09:04 | |
*** dtantsur|afk is now known as dtantsur | 09:07 | |
*** markus_z has quit IRC | 09:09 | |
*** shardy has joined #openstack-infra | 09:10 | |
*** akscram has quit IRC | 09:11 | |
*** yujunz is now known as yujunz[away] | 09:11 | |
*** markus_z has joined #openstack-infra | 09:12 | |
*** ekuris has quit IRC | 09:14 | |
*** yujunz[away] has quit IRC | 09:16 | |
AJaeger | jeblair, mordred, infra-root, 417679 was merged 90 mins ago - and I still see access to /afs/openstack.org/docs - see http://logs.openstack.org/d8/d86ff308a1c5cdf104e7390609e6a97a50589201/post/openstack-manuals-releasenotes/c5852d4/_zuul_ansible/ansible_log.txt . Do we need to restart some zuul services for 417679 to be in use? | 09:26 |
*** wolverineav has joined #openstack-infra | 09:26 | |
*** ekuris has joined #openstack-infra | 09:28 | |
AJaeger | I guess, we need to restart zuul-launcher for this change. Could anybody confirm - and do it, please? | 09:30 |
*** florianf has quit IRC | 09:31 | |
*** rbuzatu has joined #openstack-infra | 09:35 | |
*** Julien-zte has quit IRC | 09:36 | |
*** rbuzatu_ has joined #openstack-infra | 09:37 | |
*** saibarspeis has quit IRC | 09:37 | |
*** derekh has joined #openstack-infra | 09:38 | |
*** arxcruz has quit IRC | 09:40 | |
*** rbuzatu has quit IRC | 09:40 | |
*** john-davidge has joined #openstack-infra | 09:42 | |
*** roeyc has joined #openstack-infra | 09:44 | |
*** florianf has joined #openstack-infra | 09:44 | |
*** roeyc has left #openstack-infra | 09:45 | |
*** mhickey has joined #openstack-infra | 09:57 | |
*** e0ne has joined #openstack-infra | 09:59 | |
*** sambetts|afk is now known as sambetts | 10:00 | |
*** thorst has joined #openstack-infra | 10:00 | |
*** dizquierdo has joined #openstack-infra | 10:01 | |
wznoinsk | hi infra, is there any timeline for zuul v3? | 10:06 |
*** thorst has quit IRC | 10:07 | |
*** claudiub has quit IRC | 10:07 | |
*** yanyanhu has quit IRC | 10:07 | |
*** chem has joined #openstack-infra | 10:08 | |
*** umeshksingla has quit IRC | 10:18 | |
*** salv-orl_ has joined #openstack-infra | 10:22 | |
*** salv-orlando has quit IRC | 10:25 | |
*** akscram has joined #openstack-infra | 10:29 | |
*** gongysh has quit IRC | 10:31 | |
*** bauwser is now known as bauzas | 10:32 | |
*** arxcruz has joined #openstack-infra | 10:37 | |
*** ociuhandu has quit IRC | 10:39 | |
*** liujiong has quit IRC | 10:39 | |
*** tobasco has quit IRC | 10:40 | |
*** asettle has joined #openstack-infra | 10:41 | |
*** dtantsur is now known as dtantsur|brb | 10:45 | |
*** hyakuhei has quit IRC | 10:49 | |
*** hyakuhei has joined #openstack-infra | 10:49 | |
*** hyakuhei has quit IRC | 10:49 | |
*** hyakuhei has joined #openstack-infra | 10:49 | |
*** rfolco has joined #openstack-infra | 10:52 | |
*** ldnunes has joined #openstack-infra | 10:56 | |
dims | yolanda : you already +2A'ed https://review.openstack.org/#/c/417504/ however that needs https://review.openstack.org/#/c/417630/ :) please take a look when you get a chance | 10:57 |
*** claudiub has joined #openstack-infra | 10:58 | |
*** jordanP has joined #openstack-infra | 10:58 | |
openstackgerrit | Julie Pichon proposed openstack-infra/tripleo-ci: Remove references to Liberty (now EOL'd) https://review.openstack.org/417814 | 10:59 |
*** nicolasbock has joined #openstack-infra | 11:04 | |
*** tobasco has joined #openstack-infra | 11:05 | |
openstackgerrit | Julie Pichon proposed openstack-infra/tripleo-ci: Remove references to Liberty (now EOL'd) https://review.openstack.org/417814 | 11:09 |
*** nicolasbock has quit IRC | 11:11 | |
*** ldnunes has quit IRC | 11:11 | |
*** ociuhandu has joined #openstack-infra | 11:12 | |
*** tuanluong has quit IRC | 11:12 | |
*** ldnunes has joined #openstack-infra | 11:13 | |
*** salv-orl_ has quit IRC | 11:14 | |
*** salv-orlando has joined #openstack-infra | 11:15 | |
openstackgerrit | Julie Pichon proposed openstack-infra/tripleo-ci: Use the Newton node management commands https://review.openstack.org/416982 | 11:15 |
yolanda | hi dims , i was out on doctors. Resuming the review queue now | 11:16 |
dims | yolanda : much appreciated :) no worries | 11:17 |
dims | hope all's well yolanda | 11:17 |
yolanda | yep, thanks :) | 11:17 |
*** vgridnev- has quit IRC | 11:18 | |
openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: TripleO containers job with quickstart https://review.openstack.org/416259 | 11:18 |
*** vgridnev has joined #openstack-infra | 11:18 | |
*** nicolasbock has joined #openstack-infra | 11:23 | |
*** nbloom has joined #openstack-infra | 11:25 | |
openstackgerrit | Merged openstack-infra/project-config: Switch order of special and node for heat functional tests https://review.openstack.org/417630 | 11:26 |
*** dtantsur|brb is now known as dtantsur | 11:27 | |
openstackgerrit | Merged openstack-infra/project-config: python3 functional test for heat https://review.openstack.org/417504 | 11:28 |
openstackgerrit | Merged openstack-infra/project-config: Introduce TripleO multinode (x4) experimental jobs with scenario005 https://review.openstack.org/414585 | 11:29 |
openstackgerrit | Merged openstack-infra/project-config: Add grenade testing for Zaqar https://review.openstack.org/416790 | 11:30 |
openstackgerrit | Merged openstack-infra/project-config: releasenotes not part of ceilometermiddleware mitaka https://review.openstack.org/416745 | 11:31 |
openstackgerrit | Merged openstack-infra/project-config: Remove redundant gerrit-git-prep from kolla jobs https://review.openstack.org/417464 | 11:33 |
openstackgerrit | Merged openstack-infra/project-config: Add experimental jobs for tripleoclient ramdisks https://review.openstack.org/417183 | 11:33 |
openstackgerrit | Merged openstack-infra/project-config: Make gate-tripleo-buildimage-overcloud-full-centos-7 voting https://review.openstack.org/417184 | 11:33 |
openstackgerrit | Merged openstack-infra/project-config: oslo.messaging: switch to tox functional test https://review.openstack.org/417110 | 11:33 |
openstackgerrit | Merged openstack-infra/project-config: Disable novnc service for dsvm-heat-apache job https://review.openstack.org/416919 | 11:33 |
AJaeger | wznoinsk: there's a #zuul channel and a weekly meeting for zuul. You might need to wait for some US folks to wake up for an answer... | 11:35 |
*** ramishra has quit IRC | 11:40 | |
*** sdake has joined #openstack-infra | 11:41 | |
openstackgerrit | Merged openstack-infra/project-config: kuryr-kubernetes: add dragonflow to PROJECTS https://review.openstack.org/417768 | 11:42 |
*** ramishra has joined #openstack-infra | 11:43 | |
*** sdague has joined #openstack-infra | 11:59 | |
wznoinsk | AJaeger, thanks | 12:00 |
*** ekuris has quit IRC | 12:04 | |
*** rbuzatu has joined #openstack-infra | 12:07 | |
*** rtheis has joined #openstack-infra | 12:08 | |
*** rbuzatu_ has quit IRC | 12:10 | |
*** drifterza has joined #openstack-infra | 12:11 | |
*** hashar is now known as hasharLunch | 12:12 | |
*** ekuris has joined #openstack-infra | 12:17 | |
*** dkehn has quit IRC | 12:24 | |
*** thorst has joined #openstack-infra | 12:24 | |
*** thorst has quit IRC | 12:24 | |
*** ramishra has quit IRC | 12:24 | |
*** thorst has joined #openstack-infra | 12:25 | |
*** nadya has quit IRC | 12:25 | |
*** nbloom has quit IRC | 12:26 | |
*** ramishra has joined #openstack-infra | 12:27 | |
*** dkehn has joined #openstack-infra | 12:31 | |
*** zul has joined #openstack-infra | 12:31 | |
openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: Switch off glance->swift in rally+py35 tests https://review.openstack.org/417857 | 12:32 |
*** ramishra has quit IRC | 12:34 | |
*** _Cyclone_ has joined #openstack-infra | 12:34 | |
*** Julien-zte has joined #openstack-infra | 12:34 | |
*** _Cyclone_ has quit IRC | 12:34 | |
*** ramishra has joined #openstack-infra | 12:36 | |
*** sreeram_v has joined #openstack-infra | 12:37 | |
*** gongysh has joined #openstack-infra | 12:38 | |
*** e0ne has quit IRC | 12:39 | |
*** zul has quit IRC | 12:39 | |
*** zul has joined #openstack-infra | 12:40 | |
*** e0ne has joined #openstack-infra | 12:40 | |
*** e0ne has quit IRC | 12:41 | |
*** lucasagomes is now known as lucas-hungry | 12:41 | |
*** e0ne has joined #openstack-infra | 12:41 | |
*** zul has quit IRC | 12:41 | |
*** e0ne has quit IRC | 12:41 | |
*** zul has joined #openstack-infra | 12:42 | |
*** e0ne has joined #openstack-infra | 12:42 | |
*** e0ne has quit IRC | 12:42 | |
*** e0ne has joined #openstack-infra | 12:43 | |
*** e0ne has quit IRC | 12:43 | |
*** e0ne has joined #openstack-infra | 12:43 | |
*** e0ne has quit IRC | 12:44 | |
*** rhallisey has joined #openstack-infra | 12:47 | |
*** nadya has joined #openstack-infra | 12:48 | |
dims | AJaeger : yolanda : i switched off swift explicitly in https://review.openstack.org/#/c/417228/11/jenkins/jobs/projects.yaml, but swift *STILL* shows up in the job http://logs.openstack.org/18/417818/1/check/gate-rally-dsvm-py35-glance-nv/abe069b/logs/localrc.txt.gz . | 12:49 |
dims | AJaeger : yolanda : so here's a review to explicitly disable glance->swift via the config option https://review.openstack.org/#/c/417857/ | 12:50 |
*** wolverineav has quit IRC | 12:52 | |
*** gongysh has quit IRC | 12:53 | |
*** timello has quit IRC | 12:54 | |
*** flepied has quit IRC | 12:56 | |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Fix on team json format https://review.openstack.org/417864 | 12:57 |
openstackgerrit | Merged openstack-infra/openstackid-resources: Fix on team json format https://review.openstack.org/417864 | 12:59 |
*** ramishra has quit IRC | 12:59 | |
*** dprince has joined #openstack-infra | 12:59 | |
*** ramishra has joined #openstack-infra | 13:01 | |
*** ekuris has quit IRC | 13:02 | |
*** timello has joined #openstack-infra | 13:05 | |
*** ggnel_t has joined #openstack-infra | 13:06 | |
*** pgadiya has quit IRC | 13:07 | |
*** trown|outtypewww is now known as trown | 13:08 | |
*** weshay_afk is now known as weshay | 13:09 | |
*** tensionlanguage has joined #openstack-infra | 13:13 | |
*** flepied has joined #openstack-infra | 13:13 | |
*** umeshksingla has joined #openstack-infra | 13:14 | |
*** booleanfour has quit IRC | 13:15 | |
*** ekuris has joined #openstack-infra | 13:15 | |
openstackgerrit | Merged openstack-infra/openstackid-resources: Update readme file https://review.openstack.org/417449 | 13:20 |
*** salv-orlando has quit IRC | 13:21 | |
*** rlandy has joined #openstack-infra | 13:24 | |
*** kgiusti has joined #openstack-infra | 13:26 | |
*** mdrabe_ has joined #openstack-infra | 13:27 | |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Fix on team json format https://review.openstack.org/417875 | 13:27 |
*** pradk has joined #openstack-infra | 13:28 | |
openstackgerrit | Merged openstack-infra/openstackid-resources: Fix on team json format https://review.openstack.org/417875 | 13:28 |
*** benj_ has quit IRC | 13:30 | |
*** gouthamr has joined #openstack-infra | 13:31 | |
*** salv-orlando has joined #openstack-infra | 13:32 | |
*** benj_ has joined #openstack-infra | 13:34 | |
*** fguillot has joined #openstack-infra | 13:34 | |
*** fguillot has quit IRC | 13:34 | |
*** fguillot has joined #openstack-infra | 13:34 | |
*** umeshksingla has quit IRC | 13:34 | |
*** asettle has quit IRC | 13:35 | |
*** asettle has joined #openstack-infra | 13:36 | |
*** jamielennox is now known as jamielennox|away | 13:39 | |
openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support (follow-up) https://review.openstack.org/417494 | 13:40 |
*** ramishra has quit IRC | 13:43 | |
*** ramishra has joined #openstack-infra | 13:44 | |
*** srobert has joined #openstack-infra | 13:45 | |
*** thorst has quit IRC | 13:45 | |
*** thorst has joined #openstack-infra | 13:46 | |
*** nbloom has joined #openstack-infra | 13:46 | |
*** gordc has joined #openstack-infra | 13:46 | |
*** ihrachys has joined #openstack-infra | 13:47 | |
nbloom | Hi everyone :) can someone take a look at this log and perhaps tell me why the job fails? http://logs.openstack.org/74/417674/2/check/gate-vitrage-dashboard-docs-ubuntu-xenial/67f1c96/console.html | 13:48 |
*** jcoufal has joined #openstack-infra | 13:48 | |
*** rafaels has joined #openstack-infra | 13:49 | |
AJaeger | nbloom: broken docutils 2.13.1 or so possible - let me grab you a link... | 13:49 |
*** jheroux has joined #openstack-infra | 13:50 | |
AJaeger | nbloom: try http://lists.openstack.org/pipermail/openstack-dev/2016-December/108742.html | 13:50 |
*** thorst has quit IRC | 13:50 | |
*** lucas-hungry is now known as lucasagomes | 13:53 | |
*** Goneri has joined #openstack-infra | 13:53 | |
*** xyang1 has joined #openstack-infra | 13:55 | |
*** ramishra has quit IRC | 13:55 | |
*** ramishra has joined #openstack-infra | 13:55 | |
*** ldnunes has quit IRC | 13:56 | |
*** ihrachys has quit IRC | 13:57 | |
*** ramishra has quit IRC | 13:57 | |
*** ihrachys has joined #openstack-infra | 13:57 | |
nbloom | AJaeger: Thanks :) | 13:57 |
*** wolverineav has joined #openstack-infra | 13:58 | |
*** srobert_ has joined #openstack-infra | 14:00 | |
*** drifterza has quit IRC | 14:00 | |
*** knikolla has joined #openstack-infra | 14:00 | |
*** srobert_ has quit IRC | 14:01 | |
*** srobert has quit IRC | 14:01 | |
*** srobert has joined #openstack-infra | 14:01 | |
*** ramishra has joined #openstack-infra | 14:02 | |
*** nbloom has quit IRC | 14:02 | |
*** wolverin_ has joined #openstack-infra | 14:03 | |
*** thorst has joined #openstack-infra | 14:05 | |
*** wolverineav has quit IRC | 14:06 | |
*** nadya has quit IRC | 14:06 | |
*** lindycoder has joined #openstack-infra | 14:07 | |
*** Guest3684 is now known as dasm | 14:08 | |
*** ldnunes has joined #openstack-infra | 14:09 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Revert "temprevert neutron "Don't create HA resources until needed" patch" https://review.openstack.org/417888 | 14:09 |
*** krtaylor has joined #openstack-infra | 14:11 | |
*** hongbin has joined #openstack-infra | 14:12 | |
*** nadya has joined #openstack-infra | 14:14 | |
*** baoli has joined #openstack-infra | 14:15 | |
*** eharney has quit IRC | 14:15 | |
*** umeshksingla has joined #openstack-infra | 14:15 | |
*** aleph1 is now known as agarner | 14:18 | |
*** tlian has joined #openstack-infra | 14:18 | |
*** lbragstad_ is now known as lbragstad | 14:19 | |
*** john-davidge has quit IRC | 14:19 | |
*** john-dav_ has joined #openstack-infra | 14:19 | |
*** sreeram_v has quit IRC | 14:23 | |
*** jaosorior has joined #openstack-infra | 14:23 | |
openstackgerrit | Ihar Hrachyshka proposed openstack-infra/irc-meetings: Added Artur as a co-chair for the neutron upgrades meeting https://review.openstack.org/417897 | 14:24 |
*** sreeram_v has joined #openstack-infra | 14:24 | |
*** mdrabe_ has quit IRC | 14:27 | |
*** mdrabe_ has joined #openstack-infra | 14:27 | |
*** baoli has quit IRC | 14:28 | |
*** sreeram_v has quit IRC | 14:29 | |
*** superdan is now known as dansmith | 14:30 | |
*** salv-orlando has quit IRC | 14:31 | |
*** jaosorior has quit IRC | 14:31 | |
*** john-dav_ has quit IRC | 14:31 | |
*** john-davidge has joined #openstack-infra | 14:32 | |
*** jordanP has quit IRC | 14:32 | |
openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 14:33 |
*** ramishra has quit IRC | 14:33 | |
*** dave-mccowan has joined #openstack-infra | 14:33 | |
*** matt-borland has joined #openstack-infra | 14:35 | |
*** jordanP has joined #openstack-infra | 14:35 | |
*** jaosorior has joined #openstack-infra | 14:35 | |
*** Goneri has quit IRC | 14:36 | |
*** asselin has joined #openstack-infra | 14:36 | |
*** ramishra has joined #openstack-infra | 14:37 | |
*** eharney has joined #openstack-infra | 14:37 | |
*** trown is now known as trown|afk | 14:38 | |
*** asselin has quit IRC | 14:39 | |
*** rbrndt has joined #openstack-infra | 14:39 | |
fungi | AJaeger: i can get launcher restarts going if nobody else is working on that yet (i didn't see anyone here saying they were) | 14:40 |
*** psachin has quit IRC | 14:41 | |
*** baoli has joined #openstack-infra | 14:41 | |
*** baoli has quit IRC | 14:41 | |
*** rbrndt has quit IRC | 14:41 | |
AJaeger | fungi: thanks! Nobody else said anything... | 14:42 |
fungi | wznoinsk: the short answer is "when it's ready" (hopefully in a few more months?). there's also a weekly zuul dev meeting mondays (today!) at 22:00 utc in #openstack-meeting-alt if you're interested | 14:42 |
*** tonytan4ever has joined #openstack-infra | 14:42 | |
fungi | it's coming along quite quickly | 14:42 |
AJaeger | would be good to give this priority since I asked release team to not release anythign - otherwise content is missing in AFS | 14:43 |
*** umeshksingla has quit IRC | 14:43 | |
*** eharney has quit IRC | 14:43 | |
openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: remove aclmanager.py https://review.openstack.org/417900 | 14:45 |
openstackgerrit | Doug Hellmann proposed openstack-infra/project-config: set up ACLs for ocata stable branches before release candidate phase https://review.openstack.org/417901 | 14:45 |
*** rafaels has quit IRC | 14:46 | |
fungi | has infracloud-chocolate been disabled in nodepool yet? | 14:47 |
AJaeger | fungi: I doubt it | 14:47 |
fungi | i see tons of gate failures being caused by it | 14:47 |
*** ramishra has quit IRC | 14:47 | |
*** asselin has joined #openstack-infra | 14:48 | |
*** Goneri has joined #openstack-infra | 14:48 | |
*** ramishra has joined #openstack-infra | 14:49 | |
*** links has quit IRC | 14:50 | |
*** panda is now known as panda|brb | 14:51 | |
wznoinsk | fungi, thanks for coming back on this | 14:51 |
*** baoli has joined #openstack-infra | 14:51 | |
AJaeger | fungi, let me do a patch for chocolate disabling | 14:51 |
fungi | AJaeger: thanks, i've manually disabled first and am deleting remaining nodes there | 14:52 |
*** tonytan4ever has quit IRC | 14:52 | |
fungi | i'll undo my emergency puppet block once the change lands | 14:52 |
*** tonytan4ever has joined #openstack-infra | 14:52 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Disable chocolate until mirror is up again https://review.openstack.org/417904 | 14:53 |
AJaeger | fungi, ^ | 14:53 |
AJaeger | fungi, have started with restarting the zuul-launchers already? | 14:54 |
fungi | AJaeger: yep, i'm up to zl03 | 14:54 |
jianghuaw | mordred, is it the proper time for you to have a chat about the float IP issue? | 14:54 |
*** eharney has joined #openstack-infra | 14:56 | |
fungi | we're down to 0 nodepool nodes in chocolate now | 14:57 |
*** cody-somerville has joined #openstack-infra | 14:57 | |
*** cody-somerville has quit IRC | 14:57 | |
*** cody-somerville has joined #openstack-infra | 14:57 | |
fungi | so that should stop the bleeding there while we find time to investigate | 14:57 |
AJaeger | fungi, thanks | 14:59 |
fungi | AJaeger: restarts are done now. i see a openstack-ansible-openstack_openrc-docs-ubuntu-xenial job queued for 41d71da in post which should hopefully dtrt now? | 15:00 |
AJaeger | let's see... | 15:00 |
* AJaeger watches | 15:00 | |
*** zz_dimtruck is now known as dimtruck | 15:01 | |
*** yamahata has joined #openstack-infra | 15:02 | |
*** baoli has quit IRC | 15:02 | |
*** lindycoder has quit IRC | 15:03 | |
AJaeger | ... takes some time until we have a node for that docs job ;( | 15:03 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Add "undecloud" or extra node's details to OVB's nodes' json https://review.openstack.org/413548 | 15:04 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: TLS everywhere job introduction https://review.openstack.org/391738 | 15:04 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Add temporary key to OVB stack if undercloud is created https://review.openstack.org/413477 | 15:04 |
*** nmagnezi has quit IRC | 15:04 | |
*** csomerville has joined #openstack-infra | 15:05 | |
*** panda|brb is now known as panda | 15:06 | |
fungi | #status log All zuul-launcher services have been emergency restarted so that zuul.conf change https://review.openstack.org/417679 will take effect. | 15:08 |
openstackstatus | fungi: finished logging | 15:08 |
openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 15:08 |
*** cody-somerville has quit IRC | 15:08 | |
cloudnull | mornings | 15:08 |
fungi | #status log Nodepool use of Infra-cloud's chocolate region has been disabled with https://review.openstack.org/417904 while nova host issues impacting its mirror instance are investigated. | 15:09 |
openstackstatus | fungi: finished logging | 15:09 |
openstackgerrit | Merged openstack-infra/project-config: Disable chocolate until mirror is up again https://review.openstack.org/417904 | 15:10 |
fungi | AJaeger: it seems to be running now | 15:10 |
fungi | caught up pretty quickly | 15:10 |
*** mmandel has joined #openstack-infra | 15:11 | |
*** ramishra has quit IRC | 15:12 | |
AJaeger | fungi, releasenotes publishing worked! So, we should be green again. LEt's wait one or two more jobs before giving the all clear | 15:12 |
*** EricGonczer_ has joined #openstack-infra | 15:13 | |
fungi | http://logs.openstack.org/41/41d71da4d991e1ad3b9a40042993fe317a60be6c/post/openstack-ansible-openstack_openrc-docs-ubuntu-xenial/2765a6f/_zuul_ansible/post_playbook shows target: /afs/.openstack.org/docs/developer/openstack-ansible-openstack_openrc now too | 15:13 |
*** mptacekx has quit IRC | 15:14 | |
AJaeger | fungi, could you review https://review.openstack.org/417701 and https://review.openstack.org/415901 for infra-manual, please? | 15:14 |
AJaeger | fungi: good! | 15:14 |
fungi | sure | 15:14 |
*** Goneri has quit IRC | 15:16 | |
*** baoli has joined #openstack-infra | 15:16 | |
*** jianghuaw-m has joined #openstack-infra | 15:16 | |
*** umeshksingla has joined #openstack-infra | 15:18 | |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: DNM HTTP Tracing to track down networking gate issue https://review.openstack.org/417921 | 15:18 |
*** ramishra has joined #openstack-infra | 15:19 | |
pabelanger | AJaeger: fungi: I'm surprised we don't see the mirror failures in our configure_mirror.sh script, I'll have to poke into why | 15:20 |
AJaeger | good idea, pabelanger - thanks. | 15:21 |
*** jianghuaw-m has left #openstack-infra | 15:21 | |
AJaeger | pabelanger: could you push 417701 and 415901 on your review queue as well, please? | 15:21 |
AJaeger | thanks, fungi and pabelanger ! | 15:22 |
*** baoli has quit IRC | 15:22 | |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: DNM Testing a devstack revert patch https://review.openstack.org/417925 | 15:22 |
fungi | i'll go ahead and take nodepool.o.o back out of the disabled list in the emergency file now | 15:22 |
fungi | since the config change merged | 15:23 |
*** trown|afk is now known as trown | 15:23 | |
*** jianghuaw-m has joined #openstack-infra | 15:23 | |
*** mdrabe_ is now known as mdrabe | 15:23 | |
*** markvoelker has joined #openstack-infra | 15:24 | |
*** ramishra has quit IRC | 15:25 | |
openstackgerrit | Merged openstack-infra/infra-manual: Improve retiring documentation https://review.openstack.org/417701 | 15:25 |
openstackgerrit | Merged openstack-infra/infra-manual: add note to run git review -s before deleting repo https://review.openstack.org/415901 | 15:25 |
fungi | mordred: not running for a board seat this time? | 15:25 |
*** ramishra has joined #openstack-infra | 15:26 | |
*** hongbin has quit IRC | 15:26 | |
mordred | jianghuaw: normally yes - but I've got a gate failure issue I'm tracking down . in the mean time, could you run : http://paste.openstack.org/show/594297/ and paste the output for me? | 15:27 |
mordred | fungi: nope. decided I'd let someone else have a turn | 15:27 |
evrardjp | hey | 15:27 |
fungi | mordred: cool, just making sure there wasn't a problem with my ballot ;) | 15:28 |
evrardjp | did you see issues with infracloud-chocolate? like apt packages missing? | 15:28 |
odyssey4me | happy new year to all | 15:28 |
odyssey4me | seeing failures for the xenial mirror in infracloud: http://logs.openstack.org/39/417039/3/check/gate-openstack-ansible-os_keystone-linters-ubuntu-xenial/0d28c98/console.html#_2017-01-09_13_59_05_218804 | 15:28 |
evrardjp | indeed happy new year :) | 15:28 |
*** pradk- has joined #openstack-infra | 15:28 | |
AJaeger | evrardjp: we just shut down chocolate because of problems with the mirrors | 15:29 |
fungi | evrardjp: the mirror there is down. we've taken it out of rotation for the moment https://wiki.openstack.org/wiki/Infrastructure_Status | 15:29 |
evrardjp | ok cool | 15:29 |
evrardjp | thanks | 15:29 |
fungi | evrardjp: you shouldn't see any more failures like that for now | 15:29 |
odyssey4me | awesome, thanks | 15:29 |
evrardjp | \o/ | 15:29 |
*** matt-borland has quit IRC | 15:29 | |
*** tlian has quit IRC | 15:29 | |
*** knikolla has quit IRC | 15:29 | |
*** asettle has quit IRC | 15:29 | |
*** bnemec has quit IRC | 15:29 | |
*** matt-borland has joined #openstack-infra | 15:29 | |
*** tlian has joined #openstack-infra | 15:30 | |
*** knikolla has joined #openstack-infra | 15:30 | |
fungi | hopefully an infra-root with more intimate knowledge of infra-cloud host management will have time to look into what happened to those nova servers | 15:30 |
*** asettle has joined #openstack-infra | 15:30 | |
*** Goneri has joined #openstack-infra | 15:31 | |
*** ramishra has quit IRC | 15:31 | |
*** jianghuaw-m has quit IRC | 15:32 | |
pabelanger | fungi: yes, looking now | 15:32 |
fungi | awesome, thanks pabelanger! | 15:32 |
pabelanger | fungi: do you know which compute node fell over? | 15:32 |
fungi | at a minimum, the one where the mirror instance was running | 15:32 |
fungi | i'll see if anyone said in scrollback | 15:32 |
*** rafaels has joined #openstack-infra | 15:33 | |
*** bnemec has joined #openstack-infra | 15:33 | |
pabelanger | that is okay, I can find out | 15:33 |
fungi | pabelanger: jhesketh surmised that all of chocolate may be offline since he couldn't find a separate bifrost server for it and the one for vanilla doesn't have any of chocolate in its inventory (but was unsure he was checking correctly) | 15:34 |
pabelanger | IIRC, we only have a single bifrost server now | 15:35 |
pabelanger | for both regions | 15:35 |
*** Jeffrey4l_ has joined #openstack-infra | 15:35 | |
*** ociuhandu has quit IRC | 15:35 | |
fungi | could be he was looking in the wrong inventory | 15:36 |
*** marst has quit IRC | 15:36 | |
*** drifterza has joined #openstack-infra | 15:36 | |
*** mmandel has quit IRC | 15:39 | |
AJaeger | fungi, before giving the release team an all-clear, I wanted to see one openstack-manuals change merge - but that takes too long now and I'll soon be offline for two hours. Since the first tests were fine, I'll give them an all-clear now. | 15:40 |
*** jistr is now known as jistr|biab | 15:40 | |
*** sdake_ has joined #openstack-infra | 15:40 | |
pabelanger | looks like 11 compute nodes are not responding | 15:41 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Log request ids when debug logging is enabled https://review.openstack.org/417931 | 15:42 |
*** ramishra has joined #openstack-infra | 15:43 | |
*** rbrndt has joined #openstack-infra | 15:43 | |
*** sdake has quit IRC | 15:43 | |
*** jistr|biab is now known as jistr | 15:43 | |
*** d0ugal has quit IRC | 15:44 | |
*** john-davidge has quit IRC | 15:44 | |
*** d0ugal has joined #openstack-infra | 15:44 | |
*** d0ugal has quit IRC | 15:44 | |
*** d0ugal has joined #openstack-infra | 15:44 | |
*** d0ugal has quit IRC | 15:44 | |
*** markvoelker has quit IRC | 15:44 | |
*** d0ugal has joined #openstack-infra | 15:45 | |
*** d0ugal has quit IRC | 15:45 | |
*** d0ugal has joined #openstack-infra | 15:45 | |
*** john-davidge has joined #openstack-infra | 15:45 | |
*** marst has joined #openstack-infra | 15:45 | |
*** jeckersb is now known as jeckersb_gone | 15:45 | |
*** baoli has joined #openstack-infra | 15:45 | |
fungi | AJaeger: sounds good. thanks for checking so thoroughly | 15:46 |
fungi | pabelanger: maybe they had a power incident in one rack or something | 15:46 |
*** jeckersb_gone is now known as jeckersb | 15:47 | |
*** john-davidge has quit IRC | 15:47 | |
*** john-dav_ has joined #openstack-infra | 15:47 | |
fungi | wendar is probably our only contact with access to jira at this point, and she doesn't seem to be around at the moment | 15:47 |
*** jaosorior has quit IRC | 15:47 | |
*** ramishra has quit IRC | 15:48 | |
*** hasharLunch is now known as hashar | 15:48 | |
*** baoli has quit IRC | 15:48 | |
*** ramishra has joined #openstack-infra | 15:49 | |
mugsie | fungi: you looking for HPE Jira access ? | 15:50 |
*** ociuhandu has joined #openstack-infra | 15:51 | |
fungi | mugsie: potentially, if pabelanger doesn't have much luck figuring out why these servers are down and trying to remotely reboot them | 15:51 |
*** john-dav_ has quit IRC | 15:51 | |
AJaeger | fungi, could you discuss with ianw or pabelanger mirroring docs.o.o again, please? I guess once ianw is awake, I'll be asleep ;) | 15:51 |
fungi | AJaeger: yep. ianw was out all last week, pabelanger said he'd take a look sometime today, so between the two of them hopefully it can get tackled | 15:52 |
pabelanger | AJaeger: fungi: I have time to talk about that too | 15:52 |
*** baoli has joined #openstack-infra | 15:53 | |
mordred | infra-root: shade's gate (and non-voting nodepool devstack jobs) are broken. I've tosed up a couple of debug related patches and have added a hold job in nodepool to grab a failed node | 15:53 |
AJaeger | pabelanger: great! ianw documented at https://etherpad.openstack.org/p/afs-docs - see line 41 - what he did | 15:53 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Remove neutron temprevert https://review.openstack.org/417937 | 15:53 |
mordred | jianghuaw: also - are you running the latest version of shade with your nodepool? | 15:54 |
AJaeger | pabelanger: so, you need to rerun the lftp mirror command with proper parameters to update all the content | 15:54 |
pabelanger | AJaeger: okay, let me do that | 15:54 |
*** rbuzatu has quit IRC | 15:55 | |
*** deadnull has joined #openstack-infra | 15:55 | |
*** rbuzatu has joined #openstack-infra | 15:55 | |
*** ramishra has quit IRC | 15:57 | |
AJaeger | pabelanger: use mirror -e -n (the -n means only transfer newer files) | 15:57 |
AJaeger | pabelanger: so, we avoid mirroring old content | 15:57 |
AJaeger | pabelanger: still it will take several hours | 15:57 |
openstackgerrit | Sharat Sharma proposed openstack-infra/project-config: Add translation-jobs to mistral https://review.openstack.org/417942 | 15:57 |
AJaeger | and add -P6 | 15:57 |
dims | AJaeger : one job ran into a problem - Fix : https://review.openstack.org/#/c/417857/ (Details : i switched off swift explicitly in https://review.openstack.org/#/c/417228/11/jenkins/jobs/projects.yaml, but swift *STILL* shows up in the job http://logs.openstack.org/18/417818/1/check/gate-rally-dsvm-py35-glance-nv/abe069b/logs/localrc.txt.gz) | 16:00 |
*** nadya has quit IRC | 16:00 | |
*** beagles is now known as beagles_brb | 16:01 | |
*** ekuris has quit IRC | 16:01 | |
AJaeger | dims, I'll be offline for the next two+ hours. Best to ask fungi and pabelanger to review for now, please ^ | 16:02 |
* AJaeger will be back later | 16:02 | |
*** ramishra has joined #openstack-infra | 16:04 | |
*** jordanP has quit IRC | 16:05 | |
*** Swanson has quit IRC | 16:05 | |
*** jordanP has joined #openstack-infra | 16:05 | |
kfox1111 | could use a second +2. very quick review. https://review.openstack.org/#/c/417635/ | 16:07 |
* mordred would like to express how much nicer dealing with ipv6 hosts is since he got the he.net set up in his router | 16:08 | |
*** ramishra has quit IRC | 16:09 | |
*** mtanino has joined #openstack-infra | 16:09 | |
*** florianf has quit IRC | 16:10 | |
*** baoli has quit IRC | 16:10 | |
pabelanger | AJaeger: fungi: lftp mirror command running now | 16:10 |
*** ramishra has joined #openstack-infra | 16:11 | |
mugsie | mordred: I am still finding bits of the internet that are semi broken on IPv6 :/ | 16:14 |
*** andreas_s has quit IRC | 16:14 | |
mordred | mugsie: I had to set up a firewall reject rule for ipv6 for netflix, because even though they have ipv6 addresses, they don't let you stream over ipv6 because they 'can't tell what location you're coming from' | 16:15 |
*** rafaels has quit IRC | 16:15 | |
mugsie | -_- | 16:15 |
mordred | oh - sorry - because I'm coming from a tunnelbroker | 16:15 |
mordred | if I had ipv6 direct from my isp they would let me stream through that | 16:15 |
mugsie | so am i, but my provider is here in ireland | 16:15 |
mugsie | so it seems to work | 16:15 |
fungi | interestingly, i've had no trouble netflixing from my roku on a v6-enabled network, but maybe the netflix app there is smart enough to reroute over v4 or provides location info some other way | 16:16 |
mordred | I think their larger concern is non-us people using proxies to access us-only content | 16:16 |
clarkb | pabelanger: fungi: jhesketh mentioned that he couldn't tell if any hosts were registered with the baremetal00 server in vanilla yesterday. pabelanger is baremetal00 in vanilla the ironic server for both clouds? and if so is that the correct place to query for server enrollment etc? | 16:16 |
mordred | of course, my broker's pop is in dallas | 16:16 |
mugsie | I can actually get better speed over IPv6 depending on the far end | 16:16 |
mugsie | mine is 2 hops from my ISP, which is handy | 16:16 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Fix REPO_PREFIX handling of ceph repos https://review.openstack.org/409814 | 16:17 |
fungi | i route through he's iad pop, which both my broadband provider and rackspace have peering with (and most of my virtual servers are in that rackspace pop as well) | 16:18 |
fungi | and it's geographically pretty near here | 16:18 |
*** lVathan[m] has quit IRC | 16:18 | |
*** M-docaedo_vector has quit IRC | 16:19 | |
pabelanger | clarkb: fungi: jhesketh: just checked my notes, yes we only have a single bifrost node for both vanilla and chocolate: ssh barmetal00; source /opt/stack/bifrost/env-vars; ironic node-list | 16:19 |
pabelanger | clarkb: I am not sure the current status of server enrollments, I see a mixture of things that are offline and deploy failed | 16:20 |
*** rafaels has joined #openstack-infra | 16:21 | |
fungi | rcarrillocruz: ^ if you happen to be around, were you tracking any of that? | 16:21 |
*** Jeffrey4l_ has quit IRC | 16:22 | |
*** baoli has joined #openstack-infra | 16:22 | |
*** adrian_otto has joined #openstack-infra | 16:22 | |
*** flepied has quit IRC | 16:22 | |
*** hongbin has joined #openstack-infra | 16:23 | |
*** mriedem has joined #openstack-infra | 16:23 | |
openstackgerrit | Clark Boylan proposed openstack-infra/system-config: More bifrost details for infracloud https://review.openstack.org/417953 | 16:23 |
clarkb | pabelanger: fungi ^ | 16:24 |
fungi | ooh, thanks! | 16:24 |
*** Jeffrey4l_ has joined #openstack-infra | 16:24 | |
pabelanger | +2 | 16:25 |
*** florianf has joined #openstack-infra | 16:25 | |
pabelanger | I'm trying to see which server our mirror lives on, and compare to ironic | 16:25 |
clarkb | pabelanger: jhesketh was able to determine that it was on one of the hypervisors that was done | 16:25 |
clarkb | s/done/down/ | 16:25 |
clarkb | pabelanger: nova show as admin on the mirror instance should tell you what hypervisor it is on | 16:26 |
*** ramishra has quit IRC | 16:28 | |
*** jascott1_ has joined #openstack-infra | 16:28 | |
pabelanger | compute017.chocolate.ic.openstack.org is our server | 16:29 |
pabelanger | currently power off | 16:29 |
pabelanger | let me try to turn it back on | 16:29 |
*** jascott1_ has quit IRC | 16:29 | |
*** kjorgensen has joined #openstack-infra | 16:29 | |
dims | fungi : pabelanger : easy one when you get a chance please. https://review.openstack.org/#/c/417857/ | 16:30 |
*** deadnull has quit IRC | 16:31 | |
*** Diziet_ is now known as Diziet | 16:31 | |
*** panda is now known as panda|bbl | 16:32 | |
openstackgerrit | John L. Villalovos proposed openstack-infra/project-config: Run tempest smoke tests for ironic-.*-multinode job https://review.openstack.org/417959 | 16:32 |
*** markvoelker has joined #openstack-infra | 16:32 | |
fungi | dims: does that need a todo to remind you to unwind it later when swift gets py3k support working? or are you tracking it on your own? | 16:34 |
*** kjorgensen has quit IRC | 16:34 | |
clarkb | dims: fungi also that echo for $GLANCE_API_CONF looks really funny | 16:34 |
*** Qiming has quit IRC | 16:34 | |
clarkb | [[post-config|/$GLANCE_API_CONF]] is what you get out of it, is that / desired? | 16:34 |
dims | fungi : i will be reviewing all USE_PYTHON3 in project-config and devstack* periodically. tracking stuff on etherpad as well https://etherpad.openstack.org/p/support-python3.5-functional-tests | 16:35 |
fungi | yeah, i was wondering about that. is it supposed to be a bash eval, or is [[]] also some different level of heading for a special ini subformat? | 16:35 |
*** Jeffrey4l__ has joined #openstack-infra | 16:35 | |
openstackgerrit | Julie Pichon proposed openstack-infra/tripleo-ci: Remove references to Liberty (now EOL'd) https://review.openstack.org/417814 | 16:36 |
*** Guest59792 is now known as redrobot | 16:36 | |
dims | clarkb : fungi : i used the pattern already used here http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/neutron.yaml#n149 | 16:37 |
dims | i guess we need the $ to pass through and end up on the file on disk | 16:37 |
fungi | looks like a configuration heading level: http://git.openstack.org/cgit/openstack-dev/devstack/tree/doc/source/configuration.rst#n51 | 16:37 |
fungi | "meta-sections" | 16:38 |
clarkb | dims: ya I think it is being evaluated later within the context of devstack itself when reading that file | 16:38 |
*** pcaruana has quit IRC | 16:38 | |
clarkb | the / is what has me confused | 16:38 |
clarkb | oh but thats documented too /me reads more of fungi's link | 16:38 |
dims | clarkb : there's only job where the if condition is True, and that's what i want am working on | 16:38 |
*** rcernin has quit IRC | 16:38 | |
fungi | oh, got it. wondering if it should be |\$ instead of |/\$ | 16:38 |
*** Jeffrey4l_ has quit IRC | 16:39 | |
dims | so if i don't get what i need, will quickly propose another rev :) | 16:39 |
fungi | but the [[post-config|/$Q_PLUGIN_CONF_FILE]] example on line 76 of that document implies that's a special syntax | 16:39 |
clarkb | dims: fungi at least according to the devstack doc Q_PLUGIN_CONF_FILE is unique and needs the / prefix | 16:39 |
clarkb | its possible that glance also needs it too | 16:39 |
clarkb | in any case //some/path/here is valid so meh | 16:40 |
dims | clarkb : hang on then | 16:40 |
*** Qiming has joined #openstack-infra | 16:40 | |
dims | let me remove the / | 16:40 |
clarkb | dims: well it won't hurt | 16:40 |
clarkb | it may just be unnecessary extra | 16:40 |
clarkb | dims: cd //home/dims :) | 16:40 |
*** flepied has joined #openstack-infra | 16:40 | |
fungi | i guess the end result is that it ensures the path is absolute even if teh path in the raw variable is missing a leading / | 16:41 |
*** jascott1_ has joined #openstack-infra | 16:41 | |
clarkb | fungi: ya | 16:41 |
openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: Switch off glance->swift in rally+py35 tests https://review.openstack.org/417857 | 16:41 |
*** jaosorior has joined #openstack-infra | 16:41 | |
*** jaosorior has quit IRC | 16:42 | |
*** mhickey has quit IRC | 16:42 | |
*** jaosorior has joined #openstack-infra | 16:43 | |
dims | thanks clarkb, fungi ^ | 16:43 |
openstackgerrit | Merged openstack-infra/project-config: Add kolla-kubernetes for helm operator https://review.openstack.org/417635 | 16:44 |
*** vhosakot has joined #openstack-infra | 16:46 | |
*** M-docaedo_vector has joined #openstack-infra | 16:46 | |
clarkb | dims: related, is https://review.openstack.org/#/c/417720/1 ready to merge? the one project-config change that switched var names that I know of did merge | 16:47 |
rcarrillocruz | hi fungi | 16:48 |
* rcarrillocruz reads scrollback | 16:48 | |
*** nadya has joined #openstack-infra | 16:48 | |
clarkb | dims: and if you have a link to a recent USE_PYTHON3=True test run I'd like to double check that the reproduce.sh script is generated properly for you if you have link to those logs | 16:48 |
* clarkb checks etherpad | 16:48 | |
*** Guest34528 has quit IRC | 16:48 | |
rcarrillocruz | clarkb, fungi : yeah, baremetal00 serves as the bifrost server for both vanilla and chocolate | 16:49 |
*** kukacz has joined #openstack-infra | 16:49 | |
dims | clarkb : y, https://review.openstack.org/#/c/417720 can merge now. | 16:50 |
*** dizquierdo has quit IRC | 16:50 | |
dims | clarkb : i can see DEVSTACK_GATE_USE_PYTHON3 in http://logs.openstack.org/33/417533/2/check/gate-keystone-dsvm-py35-functional-v3-only-ubuntu-xenial-nv/f193103/logs/reproduce.sh | 16:50 |
openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 16:50 |
clarkb | dims: perfect thanks (for both items) | 16:51 |
*** Jeffrey4l__ has quit IRC | 16:51 | |
*** tonytan4ever has quit IRC | 16:52 | |
clarkb | sdague: you had asked for review on https://review.openstack.org/#/c/334504/ late last week. I left a comment there (there is a problem where screen logs aren't captured properly due to a path getting misset) | 16:52 |
*** tonytan4ever has joined #openstack-infra | 16:52 | |
*** beagles_brb is now known as beagles | 16:53 | |
sdague | clarkb: ok, just that one fix needed? | 16:54 |
openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 16:54 |
openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: Add save_* functions for clearer saving of artifacts https://review.openstack.org/334504 | 16:54 |
clarkb | sdague: yes I think that is it | 16:54 |
*** drifterza has quit IRC | 16:55 | |
*** makowals has quit IRC | 16:56 | |
openstackgerrit | Ken Giusti proposed openstack-infra/project-config: Deprecate the amqp1 dsvm-functional test on centos 7 https://review.openstack.org/417971 | 16:56 |
sdague | clarkb: ok, lets see if we can get that bit sorted, then I'll work on the local.conf patch on top | 16:56 |
*** ijw_ has joined #openstack-infra | 16:56 | |
*** mriedem has quit IRC | 16:56 | |
*** makowals_ has joined #openstack-infra | 16:56 | |
*** david-lyle has joined #openstack-infra | 16:57 | |
*** nadya has quit IRC | 16:57 | |
openstackgerrit | Merged openstack-infra/system-config: More bifrost details for infracloud https://review.openstack.org/417953 | 16:57 |
openstackgerrit | Merged openstack-infra/project-config: Switch off glance->swift in rally+py35 tests https://review.openstack.org/417857 | 16:58 |
*** mrtenio has joined #openstack-infra | 16:59 | |
*** tesseract has quit IRC | 16:59 | |
*** ijw has quit IRC | 16:59 | |
clarkb | dims: sdague and then sort of related to the python3 work is https://review.openstack.org/#/c/417555/ which should help us continue to ensure that reproduce.sh doesn't need python2 installed if python3 is available (though I think we need to mess with the actual invocation/shebang line of test-matrix.py for that to actually happen) | 16:59 |
clarkb | looks like dims already +1'd | 16:59 |
dims | ++ clarkb | 17:00 |
clarkb | oh but the depends on is what needs review | 17:00 |
*** markus_z has quit IRC | 17:01 | |
*** kjorgensen has joined #openstack-infra | 17:04 | |
*** kjorgens_ has joined #openstack-infra | 17:04 | |
pabelanger | mordred: q: does novaclient support clouds.yaml? | 17:05 |
fungi | pabelanger: i believe it does not, but openstackclient will | 17:05 |
fungi | pabelanger: i don't see it depending on os-client-config in http://git.openstack.org/cgit/openstack/python-novaclient/tree/requirements.txt | 17:06 |
rcarrillocruz | i believe not | 17:07 |
rcarrillocruz | neutronclient does | 17:07 |
rcarrillocruz | but memory tells me nova didn't | 17:07 |
rcarrillocruz | (happy new year everyone btw, been off for quite a while!) | 17:07 |
*** kjorgensen has quit IRC | 17:08 | |
dims | clarkb : +1 on https://review.openstack.org/#/c/417554/ | 17:09 |
fungi | rcarrillocruz: pabelanger: indeed, that looks likely based on http://git.openstack.org/cgit/openstack/python-neutronclient/tree/requirements.txt#n13 | 17:11 |
fungi | rcarrillocruz: happy new year to you as well! | 17:11 |
mordred | pabelanger: what fungi and rcarrillocruz is correct. novaclient does not. openstackclient is your better bet | 17:12 |
mordred | pabelanger: I added support to neutronclient for it because osc didn't have good neutron support for a while | 17:12 |
pabelanger | k | 17:12 |
pabelanger | issue is, I need to run nova reset-state --active mirror.regionone.infracloud-chocolate.openstack.org | 17:12 |
pabelanger | but, openstackclient doesn't support reset-state | 17:12 |
mordred | ah - I have no idea if osc can do that or not | 17:12 |
mordred | ah | 17:13 |
*** jamesdenton has joined #openstack-infra | 17:13 | |
mordred | well piddle | 17:13 |
fungi | admin function support in osc has a tendency to lag behind | 17:13 |
mordred | you could do a direct rest call using os_client_config.make_rest_client('compute', cloud= ...) ... | 17:13 |
*** asettle has quit IRC | 17:14 | |
*** trown is now known as trown|lunch | 17:14 | |
openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate: Run test-matrix.py under python3 if present https://review.openstack.org/417982 | 17:15 |
clarkb | dims: and something like ^ to actually just use python3 there | 17:15 |
stevemar | pabelanger: hmm, it doesn't? | 17:16 |
clarkb | pabelanger: does that imply you were able to successfully reboot the hypervisor using ironic? | 17:16 |
pabelanger | clarkb: yes, server back online, but VM in bad state. Trying to fix that | 17:16 |
stevemar | pabelanger: `openstack server set <server_name_or_id> --state <active, error> | 17:16 |
pabelanger | stevemar: Oh... | 17:17 |
stevemar | http://docs.openstack.org/developer/python-openstackclient/command-objects/server.html#server-set | 17:17 |
*** inc0 has joined #openstack-infra | 17:18 | |
*** tnovacik has joined #openstack-infra | 17:19 | |
dims | clarkb : python3-PyYAML - you confirmed on a fedora system? LGTM otherwise | 17:19 |
clarkb | dims: https://apps.fedoraproject.org/packages/python3-PyYAML and we should enable epel I think | 17:20 |
clarkb | dims: change is self testing though so should fail on that stuff if I got it wrong | 17:20 |
*** tonytan4ever has quit IRC | 17:20 | |
*** tonytan4ever has joined #openstack-infra | 17:21 | |
pabelanger | stevemar: thanks, was looking in the wrong place | 17:21 |
dims | clarkb : works for me! | 17:21 |
*** emerson has quit IRC | 17:23 | |
fungi | stepping out to run a quick errand, brb | 17:23 |
pabelanger | http://mirror.regionone.infracloud-chocolate.openstack.org/ | 17:26 |
pabelanger | stevemar: thanks for the help | 17:27 |
*** mriedem has joined #openstack-infra | 17:28 | |
openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Revert "Disable chocolate until mirror is up again" https://review.openstack.org/417985 | 17:29 |
pabelanger | fungi: clarkb: ^ | 17:29 |
*** jpich has quit IRC | 17:31 | |
*** umeshksingla has quit IRC | 17:31 | |
*** hashar is now known as hasharAway | 17:32 | |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Log request ids when debug logging is enabled https://review.openstack.org/417931 | 17:32 |
*** jheroux has quit IRC | 17:32 | |
*** jheroux has joined #openstack-infra | 17:38 | |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Cherry-pick neutron ha fix https://review.openstack.org/417989 | 17:39 |
*** jascott1_ has quit IRC | 17:39 | |
*** liusheng has quit IRC | 17:40 | |
*** liusheng has joined #openstack-infra | 17:41 | |
*** toabctl has quit IRC | 17:42 | |
*** dtantsur has quit IRC | 17:42 | |
*** dtantsur has joined #openstack-infra | 17:44 | |
*** yamahata has quit IRC | 17:45 | |
*** jascott1_ has joined #openstack-infra | 17:45 | |
openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 17:46 |
*** dtantsur is now known as dtantsur|afk | 17:46 | |
pabelanger | mordred: So, we are still getting some username / password exceptions from RAX glance API. Do you have some times to poke at it for nodepool? | 17:46 |
*** liusheng has quit IRC | 17:47 | |
*** liusheng has joined #openstack-infra | 17:47 | |
mordred | sure. | 17:48 |
mordred | pabelanger: where ya seeing them/ | 17:48 |
mordred | ? | 17:48 |
*** tonytan4ever has quit IRC | 17:48 | |
pabelanger | mordred: nb01.o.o /var/log/nodepool/builder-debug.log | 17:49 |
*** tonytan4ever has joined #openstack-infra | 17:49 | |
openstackgerrit | Merged openstack-infra/nodepool: Fix some doc typos https://review.openstack.org/412571 | 17:49 |
openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Create per-provider ZK work threads https://review.openstack.org/417994 | 17:50 |
*** nadya has joined #openstack-infra | 17:50 | |
mordred | pabelanger: that should be fixed/different error with latest shade | 17:51 |
pabelanger | mordred: we haven't deleted images in quiet some time from rax, I think we're pushing around 400 leaked images | 17:51 |
pabelanger | mordred: okay, great | 17:51 |
mordred | pabelanger: nod | 17:51 |
mordred | pabelanger: perhaps we should restart ... EXCEPT | 17:51 |
*** Guest96631 is now known as mgagne | 17:51 | |
mordred | let's hold off, since it's just a leak for now | 17:51 |
*** mgagne has quit IRC | 17:51 | |
*** mgagne has joined #openstack-infra | 17:51 | |
mordred | pabelanger: because the shade gate is broken so landing an emergency fix if there is a problem uncovered by the upgrade will be "hard" | 17:51 |
pabelanger | ++ | 17:51 |
mordred | actively investigating the gate break currently with sc` | 17:52 |
mordred | gah | 17:52 |
mordred | actively investigating the gate break currently with sc86cal | 17:52 |
*** bhunter71 has joined #openstack-infra | 17:54 | |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Fix on missing using added missing using on DoctrineChatTeamInvitationRepository https://review.openstack.org/417996 | 17:56 |
*** dtantsur|afk has quit IRC | 17:57 | |
*** csaba has quit IRC | 17:58 | |
*** pblaho has quit IRC | 17:58 | |
*** pblaho has joined #openstack-infra | 17:58 | |
*** derekh has quit IRC | 17:58 | |
*** itisha has joined #openstack-infra | 17:58 | |
*** csaba has joined #openstack-infra | 17:58 | |
*** lucasagomes is now known as lucas-afk | 17:59 | |
*** dtantsur has joined #openstack-infra | 17:59 | |
*** tonytan4ever has quit IRC | 18:00 | |
*** tonytan4ever has joined #openstack-infra | 18:00 | |
openstackgerrit | Merged openstack-infra/openstackid-resources: Fix on missing using added missing using on DoctrineChatTeamInvitationRepository https://review.openstack.org/417996 | 18:00 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Add temporary key to OVB stack if undercloud is created https://review.openstack.org/413477 | 18:03 |
*** bhunter71 has quit IRC | 18:04 | |
openstackgerrit | Merged openstack-infra/tripleo-ci: Remove the current CI matrix from tripleo-ci https://review.openstack.org/409697 | 18:04 |
*** ihrachys_ has joined #openstack-infra | 18:04 | |
openstackgerrit | Merged openstack-infra/project-config: Revert "Disable chocolate until mirror is up again" https://review.openstack.org/417985 | 18:05 |
*** mriedem has quit IRC | 18:05 | |
*** ralonsoh has quit IRC | 18:05 | |
*** woodster_ has joined #openstack-infra | 18:06 | |
*** ihrachys has quit IRC | 18:06 | |
*** spzala has joined #openstack-infra | 18:08 | |
*** bhunter71 has joined #openstack-infra | 18:08 | |
openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Remove --no-launches nodepoold option https://review.openstack.org/418001 | 18:09 |
*** trown|lunch is now known as trown | 18:11 | |
*** jascott1_ has quit IRC | 18:13 | |
*** nadya has quit IRC | 18:14 | |
clarkb | pabelanger: you didn't reboot all the down hosts in chocolate did you? if you didn't I'd like to do that (just to get experience with it) | 18:15 |
*** palendae has joined #openstack-infra | 18:15 | |
clarkb | pabelanger: and if you did, oh well I am srue there will be another opportunity :) | 18:15 |
palendae | Is this the channel to get help on customizing setup.{cfg,py} for pbr? | 18:16 |
clarkb | palendae: it is probably one of the better locations (oslo's channel being the other) | 18:16 |
*** lVathan[m] has joined #openstack-infra | 18:16 | |
pabelanger | clarkb: not all, I'm still working though them. If you want to finish up, I'm okay with that | 18:16 |
clarkb | pabelanger: if that is ok with you I'd like to do that just to get hands on with infra cloud a bit more | 18:17 |
pabelanger | clarkb: sure, np | 18:17 |
clarkb | I am gonna grab caffiene and breakfast then get to it | 18:17 |
palendae | I'm looking to modify the setup.cfg/py for openstack-ansible (http://git.openstack.org/cgit/openstack/openstack-ansible/tree/) such that the 'lib' directory is the root for the package | 18:17 |
*** drifterza has joined #openstack-infra | 18:18 | |
mordred | palendae: hi!~ | 18:19 |
palendae | o/ mordred | 18:19 |
mordred | palendae: that is not supported in pbr, nor will it be | 18:19 |
palendae | Ok, that's what I thought... | 18:19 |
palendae | mordred: So is there a way to write our own setup.py and get global requirements updates? | 18:19 |
palendae | afaik the only reason openstack-ansible has a setup.py/pbr right now is for that | 18:20 |
mordred | palendae: we'd like to avoid that - let me look at your tree real quick | 18:20 |
mordred | palendae: oh - you don't actually use your setup.py for anything? | 18:20 |
palendae | Not other than updates | 18:20 |
palendae | The majority of the stuff in there is ansible playbooks in YAML | 18:21 |
palendae | But we would like to take the python parts and make them installable | 18:21 |
mordred | those are python ansible modules right? | 18:21 |
sigmavirus | mordred: in lib? no | 18:22 |
palendae | In lib, no - they're modules used by the playbooks/inventory/dynamic_inventory.py script. But we'd like to, eventually, make them pluggable via stevedore | 18:22 |
*** yamahata has joined #openstack-infra | 18:22 | |
palendae | They're not given directly to ansible; ansible calls the dynamic_inventory.py script via subprocess | 18:22 |
sigmavirus | also "that is not supported in pbr, nor will it be" is rather a horrible opinion to have of an increasingly common way of structuring repositories and having setuptools discover the modules (inside a separate directory) | 18:22 |
mordred | gotcha. so - in that case, honestly, I'd rename lib to openstack_ansible so that they can get installed into site-packages | 18:22 |
sigmavirus | That attitude will ensure that only OpenStack will ever use PBR going forward | 18:22 |
palendae | I'm in agreement with sigmavirus there...but I'll try renaming the dir | 18:23 |
sigmavirus | I don't think that was ever the intent behind the project | 18:23 |
AJaeger | rakhmerov, are you around to discuss i18n for mistral? | 18:23 |
*** Jeffrey4l_ has joined #openstack-infra | 18:23 | |
palendae | Unfortunately the pbr opinions block off a lot of functionality | 18:23 |
mordred | sigmavirus: well, there is no specific reason one _must_ put things into a lib subdir. it does not add functionality to do so | 18:23 |
mordred | it is a way people can choose to organize things | 18:23 |
sigmavirus | mordred: I'm not saying pbr should enforce that. But it shouldn't prevent it either | 18:24 |
palendae | mordred: Right; it's a way people can choose to organize, and pbr's explicitly preventing it | 18:24 |
*** gyee has joined #openstack-infra | 18:24 | |
mordred | pbr's entire purpose in life is to remove choice so that people can just do things one way and ahve that way work every time. setuptools is available if someone wants things to be more complex | 18:24 |
palendae | So if I simply use setuptools, do I lose global requirements updating? | 18:25 |
mordred | please do not do that if you are an openstack project | 18:25 |
palendae | ... | 18:25 |
*** rafaelss has joined #openstack-infra | 18:25 | |
mordred | the reason that pbr is so opininate is that we have 1500 python repos and the flexibility of choice offered by setuptools is too large | 18:25 |
sigmavirus | mordred: if that were true, passing through all options to setuptools shouldn't be a thing pbr does, because that sounds contrary to its purpose and it seems to not be internally consistent | 18:25 |
palendae | That seems like a very poor stance | 18:25 |
*** Hal has joined #openstack-infra | 18:26 | |
*** Hal is now known as Guest65629 | 18:26 | |
palendae | mordred: So you're saying if pbr restricts a project too much, feel free to use setuptools...however if that project is hosted in openstack repos, don't use setuptools | 18:26 |
mordred | so - the thing I would imagine you're trying to do by having 6 bare python files in a lib dir is to get those installed into site-packages directly. that would result in top level modules named "filesystem" and "ip" and "tools" - which is a pretty dirty thing to do to a system. is there a reason to _not_ put them into a module that is related to the project they are in? | 18:27 |
clarkb | pabelanger: looks like I want to touch all the instances that are in a state of power off + active (eg ignore deploy failed nodes)? | 18:27 |
mordred | palendae: I'm saying for non-openstack projects, there is nothing stopping people from using setuptools | 18:27 |
mordred | I'm saying for openstack projects the consistency provided by reduction of flexibilty is valuable | 18:27 |
mordred | it's two different problems | 18:27 |
palendae | yeah | 18:28 |
palendae | Well, we're an optenstack project that would appreciate it | 18:28 |
mordred | totally understand | 18:28 |
palendae | And I would put them in a module | 18:28 |
palendae | If I put them in lib/openstack_ansible that's fine | 18:28 |
mordred | yah - so why not just put them in a model? | 18:28 |
openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Remove --no-builder nodepoold option https://review.openstack.org/418013 | 18:28 |
mordred | just rename lib to openstack_ansible and it'll just work | 18:28 |
mordred | why do you need the lib dir? | 18:28 |
*** sdake_ has quit IRC | 18:28 | |
*** rafaels has quit IRC | 18:28 | |
*** sdake has joined #openstack-infra | 18:28 | |
palendae | Initially that was there as a place to put refactored code | 18:29 |
palendae | It was all in a single .py file | 18:29 |
palendae | And it was 'lib' to differentiate from most of the code being ansible playbooks | 18:29 |
mordred | nod | 18:29 |
pabelanger | clarkb: yes, I set node-set-maintenance off then node-set-power-state reboot for those nodes after some time, the physical server came back online | 18:29 |
palendae | I'll try that | 18:29 |
clarkb | pabelanger: and they automagically enter maintenance when ironic has trouble with them? | 18:30 |
*** thorst has quit IRC | 18:30 | |
clarkb | pabelanger: but then I should be able to go over to the chocolate controller and see that those nodes have reconnected to nova ya? /me sets that up too | 18:30 |
*** thorst has joined #openstack-infra | 18:31 | |
mordred | palendae: I really didn't/don't mean to be negative - if there is a use case that you need that we're not handling, I very much want to support you if at all possible - I just want to start with seeing if we can do so without divergence first | 18:31 |
pabelanger | clarkb: looks that way, ironic node-show will list a maintenance_reason | 18:31 |
clarkb | pabelanger: tyty | 18:31 |
*** harlowja_ has joined #openstack-infra | 18:31 | |
*** harlowja has quit IRC | 18:31 | |
*** sdake_ has joined #openstack-infra | 18:31 | |
palendae | mordred: I understand; changing the directory name's going to be the path of least resistance | 18:32 |
palendae | I'm just frustrated by the "oh, well just use setuptools...but only use pbr if you're an openstack project" stance | 18:32 |
palendae | I'd rather just hear "we don't support setuptools without pbr", personally | 18:32 |
mordred | palendae: yes - sorry - that's what I should have said - I got things confused by also trying to answer the question about wider adoption of pbr in the same conversation | 18:33 |
palendae | Gotcha | 18:33 |
mordred | palendae: the stance actually is "we do not support setuptools without pbr in openstack" | 18:33 |
*** sdake has quit IRC | 18:33 | |
palendae | Ok | 18:33 |
palendae | And, I assume, pbr's not supported outside of openstack? | 18:33 |
mordred | it is | 18:33 |
palendae | I can't imagine using it otherwise | 18:33 |
mordred | there are plenty of non-openstack projects using it | 18:34 |
mordred | but that's not its primary goal | 18:34 |
palendae | Sure | 18:34 |
*** thorst has quit IRC | 18:35 | |
palendae | anyway, that addresses the main questions, so thanks mordred! | 18:35 |
clarkb | pabelanger: I am noticing that ironic things compute024 is powered off but it is up (I can ssh to it and nova says it is there) so I am going to skip that one for now and do some of the others | 18:36 |
clarkb | pabelanger: but maybe you know what is going on with 024? | 18:36 |
*** sambetts is now known as sambetts|afk | 18:36 | |
mordred | palendae: you're welcome! sorry for the confusion and/or tone | 18:36 |
pabelanger | clarkb: sure, let me look | 18:38 |
*** xnox has quit IRC | 18:38 | |
*** tonytan4ever has quit IRC | 18:38 | |
*** pradk- has quit IRC | 18:39 | |
*** erlon is now known as erlon_pto | 18:39 | |
*** tonytan4ever has joined #openstack-infra | 18:39 | |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Remove the ability for nodepoold to launch a builder https://review.openstack.org/410939 | 18:39 |
*** sdake has joined #openstack-infra | 18:39 | |
*** nadya has joined #openstack-infra | 18:39 | |
openstackgerrit | Merged openstack-infra/zuul: Fix test_rerun_on_abort https://review.openstack.org/411426 | 18:40 |
pabelanger | clarkb: ya, looks like ironic shut it off, when it was actually still online (network issue?) | 18:40 |
*** xnox has joined #openstack-infra | 18:40 | |
*** drifterza has quit IRC | 18:41 | |
*** rbrndt has quit IRC | 18:41 | |
clarkb | I have 042 rebooting now | 18:41 |
pabelanger | clarkb: if we take it out of maintenance, will ironic poll it again to get the correct state? | 18:41 |
clarkb | pabelanger: maybe? | 18:42 |
clarkb | pabelanger: probably worht trying | 18:42 |
pabelanger | reading docs now to see | 18:42 |
*** sdake_ has quit IRC | 18:42 | |
clarkb | worst case we reboot it like the others and zuul restarts any jobs on VMs there | 18:42 |
pabelanger | ya | 18:42 |
clarkb | pabelanger: it is normal for reboot to take a while before nova sees the hypervisor/ssh works ya? | 18:43 |
clarkb | guessing this hardware needs like 5-10 minutes to round trip on that | 18:43 |
pabelanger | clarkb: Ya, took some time | 18:43 |
*** e0ne has joined #openstack-infra | 18:46 | |
clarkb | ok, 042 seems happy again. Hopefully last question, do I need to clean up VMs that were running on 042 before whatever happened? | 18:46 |
clarkb | pabelanger: ^ | 18:46 |
clarkb | server list --all-projects shows every VM is active so I guess not | 18:47 |
pabelanger | clarkb: So, I haven't done any VM cleanup, yet | 18:47 |
pabelanger | figured nodepool would seem them a leaked nodes | 18:47 |
clarkb | pabelanger: ya I think that is what happened, at least querying as admin I only see happy active VMs | 18:48 |
*** thorst has joined #openstack-infra | 18:49 | |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Fix on get my invitations https://review.openstack.org/418021 | 18:49 |
*** rtheis has quit IRC | 18:52 | |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Fix on get my invitations https://review.openstack.org/418021 | 18:53 |
pabelanger | clarkb: I know I mentioned it before, but it would have been neat for nodepool to realise our VM for the AFS mirror was online, attempt to destroy it, and launch a replacement. | 18:53 |
pabelanger | s/online/offline | 18:53 |
fungi | pabelanger: yep, in the past we've discussed various auto(re)deployment schemes, some of which might integrate with a future state/feature of nodepool | 18:54 |
fungi | pabelanger: what makes it a bit of a challenge to generalize across providers right now is lack of consistent ip addressing necessitating automated dns changes | 18:55 |
clarkb | ya, I just wonder if nodepool is the right place for that since mirrors aren't inherently a nodepool thing | 18:55 |
clarkb | (heat for example can do all that for you I think) | 18:55 |
*** john-davidge has joined #openstack-infra | 18:55 | |
pabelanger | fungi: Ya, dns is a thing to deal with for sure | 18:55 |
clarkb | (or even ansible with os_server? and a loop?) | 18:55 |
mordred | we could totally do it with launcher | 18:56 |
*** rbuzatu_ has joined #openstack-infra | 18:56 | |
openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 18:56 |
pabelanger | mordred: which launcher :) | 18:56 |
fungi | pabelanger: what is a lot cheaper though is if nodepool failed to bring nodes into service (or didn't even try to boot them?) when the mirror is unreachable | 18:56 |
mordred | pabelanger: hte ansible cloud launcher - ricky's thing | 18:56 |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Add failures output of ovb stack to TE_DATAFILE https://review.openstack.org/418028 | 18:56 |
mordred | pabelanger: we could probably pretty safely make a playbook that defines all of the AFS mirrors and ensures they stay around | 18:57 |
clarkb | mordred: ya that and add "convergence" by putting an invocation in a cron loop somewhere | 18:57 |
clarkb | as fungi points out the tricky thing is likely dns though | 18:57 |
pabelanger | I think the missing piece right now is the ansible-role-puppet bit | 18:58 |
fungi | right, i think we will need to un-table our back-burner dns automation ideas as a prerequisite | 18:58 |
pabelanger | for cloud-launcher | 18:58 |
*** rbuzatu has quit IRC | 18:59 | |
*** nadya has quit IRC | 19:00 | |
*** makowals_ has quit IRC | 19:03 | |
*** dtardivel has quit IRC | 19:04 | |
*** makowals has joined #openstack-infra | 19:05 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Add stack-show output of ovb stack to TE_DATAFILE https://review.openstack.org/418028 | 19:05 |
*** claudiub|2 has joined #openstack-infra | 19:05 | |
*** bhunter71 has quit IRC | 19:06 | |
clarkb | around 2017-01-08 19:33:43 a number of our logstash worker processes stopped getting gearman events | 19:07 |
clarkb | its weird because that timestamp shows up on many of the servers as when they went down on polling the connection | 19:07 |
clarkb | so not an OOM issue I don't think | 19:08 |
clarkb | possible network problems? in any case restarting those workers so they do work again | 19:08 |
*** claudiub has quit IRC | 19:09 | |
openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Add stack-show output of ovb stack to TE_DATAFILE https://review.openstack.org/418028 | 19:12 |
mikal | Shall I assume the apt mirror issues with python35 tests are a known issue? | 19:13 |
clarkb | mikal: if the job ran in infracloud then yes | 19:14 |
fungi | mikal: are they for the infra-cloud "chocolate" region? if so that's been resolved for a while | 19:14 |
mikal | Is that the chocolate thing? | 19:14 |
mikal | Yeah, that | 19:14 |
clarkb | mikal: yup | 19:14 |
mikal | Ok, I'll recheck | 19:14 |
*** ianychoi has quit IRC | 19:14 | |
clarkb | pabelanger: did you try setting 024 to maintenance off? I see that it is currently still True so if you did that didn't help. If you didn't I can go ahead and give it a try | 19:15 |
*** rcernin has joined #openstack-infra | 19:15 | |
fungi | mikal: we took it out of service around 15:00 utc so should only be impacting results from then or earlier | 19:15 |
*** rbrndt has joined #openstack-infra | 19:15 | |
mikal | Yep, these are failures from about 12 hours ago | 19:15 |
fungi | pabelanger: clarkb: feel free to #status log a followup to my last entry at the top of https://wiki.openstack.org/wiki/Infrastructure_Status | 19:16 |
clarkb | pabelanger: also 064 is supposedly powered on but nova sees it as off and I cannot ssh to it. So I am going to reboot it via ironic as well | 19:16 |
clarkb | fungi: will do as soon as these last few items are cleared up | 19:16 |
clarkb | pabelanger: also 002 so rebooting that one too | 19:17 |
*** pradk has quit IRC | 19:17 | |
pabelanger | ++ | 19:19 |
pabelanger | clarkb: not yet, I can do it now | 19:19 |
pabelanger | clarkb: okay, off now | 19:19 |
pabelanger | lets see what happens | 19:19 |
*** dizquierdo has joined #openstack-infra | 19:20 | |
*** jordanP has quit IRC | 19:20 | |
openstackgerrit | Merged openstack-infra/project-config: add networking-sfc tempest tests into periodic jobs. https://review.openstack.org/409955 | 19:22 |
clarkb | #status log using ironic node-set-maintenance $node off && ironic node-set-power-state $node reboot infracloud hypervisors that had disappeared were brought back to life. The mirror VM was then reenabled with openstack server set $vm_name active. | 19:23 |
openstackstatus | clarkb: finished logging | 19:23 |
clarkb | fungi: ^ that help? | 19:23 |
*** aviau has quit IRC | 19:23 | |
*** aviau has joined #openstack-infra | 19:24 | |
clarkb | still trying to get into 002 and 064 | 19:24 |
*** ihrachys_ has quit IRC | 19:25 | |
clarkb | pabelanger: 2017-01-09 19:15:56.484 17967 ERROR oslo.messaging._drivers.impl_rabbit [-] AMQP server on controller00.chocolate.ic.openstack.org:5671 is unreachable: [Errno -2] Name or service not known. Trying again in 32 seconds. is the problem with 064 | 19:27 |
clarkb | oh wait thats older logs | 19:28 |
*** pradk has joined #openstack-infra | 19:28 | |
*** pradk has quit IRC | 19:28 | |
*** david-lyle has quit IRC | 19:28 | |
fungi | clarkb: thanks, i guess one can infer from it that we've brought chocolate back into service for nodepool | 19:32 |
clarkb | I can make that connection via nc and it seems to be fine. Also hasn't logged it in a bit but controller still says that compute host is down. | 19:32 |
clarkb | if I grep for the controller on the compute host I don't get much. Do we not log debug? | 19:32 |
pabelanger | clarkb: no debug by default | 19:33 |
clarkb | grep says no... I wonder if we need that | 19:33 |
clarkb | pabelanger: for 064 I am going to try force up the service via compute service set --up compute064.chocolate.ic.openstack.org | 19:34 |
clarkb | pabelanger: since I see nothing else broken | 19:34 |
pabelanger | clarkb: ack | 19:35 |
*** pradk has joined #openstack-infra | 19:35 | |
clarkb | Compute service nova-compute of host compute064.chocolate.ic.openstack.org failed to set. | 19:36 |
*** MasterOfBugs has joined #openstack-infra | 19:36 | |
*** cgfielde has joined #openstack-infra | 19:36 | |
clarkb | but that generated an error in the compute log so progress. Looks like nova-compute can't connect to libvirt socket | 19:36 |
openstackgerrit | Merged openstack-infra/devstack-gate: Remove USE_PYTHON3 usage https://review.openstack.org/417720 | 19:38 |
*** bhunter71 has joined #openstack-infra | 19:38 | |
clarkb | success, I had to restart the libvirt-bin process then the nova-compute process and it updated itself | 19:39 |
*** dprince has quit IRC | 19:40 | |
clarkb | 002 is still unresponsive | 19:41 |
clarkb | pabelanger: 024 shows power on now, but it also shows it went back to maintenance :/ | 19:42 |
*** john-davidge has quit IRC | 19:43 | |
openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 19:45 |
openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Implement major upgrade for Newton to Ocata https://review.openstack.org/404831 | 19:45 |
clarkb | pabelanger: reading the maintenance reason it appears it will flip that toggle any time it discovers an unexpected state so I think it is safe to set it back to maintenance off. Doing that now | 19:46 |
clarkb | and now it is ahppy | 19:47 |
openstackgerrit | Ben Kero proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 19:48 |
clarkb | \o/ only node that is out of whack is 002 and that may require a ticket? I can't get it to talk to me though ironic seems to think it is active | 19:48 |
clarkb | rcarrillocruz: if you have a moment at some point in the future poking at chocolate compute 002 would be helpful | 19:48 |
*** umeshksingla has joined #openstack-infra | 19:48 | |
pabelanger | clarkb: cool, did you do anything for 024? | 19:49 |
clarkb | pabelanger: I set it back to maintenance off | 19:50 |
*** pcaruana has joined #openstack-infra | 19:50 | |
pabelanger | and reboot? | 19:50 |
AJaeger | mriedem, sdague, dims: Could you review this nova py35 change, please? https://review.openstack.org/410105 | 19:50 |
clarkb | pabelanger: basically anytime you set maintenance off and it finds a state it doesnt expect it set maintenance on. So when you set it off and it transition from powered off -> on without an actual reboot it set maintenance back on immediatlely beacuse that was an unexpected state | 19:50 |
pabelanger | k | 19:50 |
clarkb | pabelanger: so I set it back to maintenance off again and this time it had no state transition beacuse it was powered on and discovered it on and so stayed that way. No reboot | 19:50 |
*** dimtruck is now known as zz_dimtruck | 19:51 | |
rcarrillocruz | clarkb: that's going to be tricky, if there are HW issues i cannot open tickets | 19:51 |
rcarrillocruz | from today, I no longer work at HP, just started at Ansible | 19:51 |
rcarrillocruz | asselin may have access to the ticketing system | 19:52 |
asselin | hi....what's up? | 19:52 |
dims | AJaeger : lgtm | 19:53 |
*** umeshksingla has quit IRC | 19:53 | |
openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Run fedora platform job against devstack-gate https://review.openstack.org/418080 | 19:53 |
AJaeger | thanks, sdague and dims | 19:53 |
clarkb | AJaeger: ianw can has review on 418080? | 19:54 |
*** umeshksingla has joined #openstack-infra | 19:54 | |
clarkb | rcarrillocruz: mugsie earlier had asked about it. I guess my question is more what can we do on our end to debug or do we have to file a ticket at this point? | 19:54 |
AJaeger | clarkb: on it... | 19:54 |
rcarrillocruz | asselin: it seems the infracloud machines have hw issues | 19:54 |
AJaeger | any takers on reviewing https://review.openstack.org/#/c/417693 - step 1 of retiring fairy-slipper - ,please? | 19:54 |
rcarrillocruz | but i cannot access Jira anymore | 19:54 |
asselin | rcarrillocruz, ok...I did see an e-mail about power interruption in houston am2 | 19:55 |
rcarrillocruz | oh | 19:55 |
rcarrillocruz | nice | 19:55 |
rcarrillocruz | clarkb: ^ | 19:55 |
*** e0ne has quit IRC | 19:55 | |
rcarrillocruz | that might be it | 19:55 |
rcarrillocruz | that's the DC where the infracloud is | 19:55 |
mugsie | they did claim there was no impact, but it could be the issue | 19:56 |
clarkb | yup, and we rebooted all the other instances that died and got them back in but 002 is still non responsive | 19:56 |
asselin | On 01/09/2017 at 6:44 am (CST), Utility power was restored at 7:42 am (CST). | 19:56 |
clarkb | oh no this happened like 2 days ago | 19:56 |
clarkb | on the 7th | 19:56 |
rcarrillocruz | haha, it wouldn't suprirse me if there were issues 2 days ago | 19:56 |
*** e0ne has joined #openstack-infra | 19:56 | |
rcarrillocruz | and today the had a schduled maintenance window to address power or go figure | 19:57 |
clarkb | anyways we are 95% back to normal. One host does not come back to us if asked to reboot but ironic thinks it is powered up | 19:57 |
clarkb | that one host is infracloud chocolate compute 002 | 19:57 |
*** e0ne has quit IRC | 19:57 | |
clarkb | rcarrillocruz: so more generally is there any other debugging you/we can do on our end before filing a ticket? | 19:57 |
*** e0ne has joined #openstack-infra | 19:57 | |
pabelanger | we should be able to get onto console, if ironic sees compute002.chocolate.ic.openstack.org online | 19:57 |
rcarrillocruz | i can look in a bit, about to jump in a call | 19:57 |
rcarrillocruz | but normally i just get into iLO and see what's up | 19:58 |
*** e0ne has quit IRC | 19:58 | |
*** umeshksingla has quit IRC | 19:58 | |
*** e0ne has joined #openstack-infra | 19:58 | |
clarkb | and ilo is located at the ipmi addr and uses the impi passwd? | 19:59 |
openstackgerrit | Merged openstack-infra/openstackid-resources: Fix on get my invitations https://review.openstack.org/418021 | 19:59 |
*** umeshksingla has joined #openstack-infra | 19:59 | |
*** umeshksingla has quit IRC | 19:59 | |
*** umeshksingla has joined #openstack-infra | 19:59 | |
*** e0ne has quit IRC | 20:00 | |
openstackgerrit | Merged openstack-infra/project-config: Add functional-py35 non-voting job for Nova https://review.openstack.org/410105 | 20:00 |
openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Fix on create/update team desc validation now team description if set to empty or null is reseted https://review.openstack.org/418083 | 20:00 |
openstackgerrit | Merged openstack-infra/openstackid-resources: Fix on create/update team desc validation now team description if set to empty or null is reseted https://review.openstack.org/418083 | 20:02 |
*** panda|bbl is now known as panda | 20:02 | |
*** e0ne has joined #openstack-infra | 20:03 | |
*** e0ne has quit IRC | 20:03 | |
rcarrillocruz | clarkb: yah, that's right | 20:04 |
clarkb | now to find where the ipmi password is stashed | 20:04 |
jroll | clarkb: driver_info | 20:05 |
jroll | and in more recent ironic, hidden with policy stuff | 20:05 |
*** salv-orlando has joined #openstack-infra | 20:05 | |
pabelanger | clarkb: /opt/stack/baremetal.json I believe | 20:05 |
*** bhunter71 has quit IRC | 20:06 | |
clarkb | jroll: thanks, bifrost also has it in the inventory file which is ^ | 20:06 |
*** gouthamr has quit IRC | 20:06 | |
jroll | ah right | 20:06 |
*** salv-orlando has quit IRC | 20:10 | |
*** andreww has quit IRC | 20:11 | |
clarkb | the last recorded entry in /system1/log1 is from july of 2016 so nothing there | 20:13 |
clarkb | rcarrillocruz: pabelanger any other hints at what I should be looking at? | 20:13 |
rcarrillocruz | in a call, can look later, sorry | 20:13 |
pabelanger | clarkb: no, I've never used the iLO before | 20:13 |
*** ldnunes has quit IRC | 20:15 | |
*** bknudson has left #openstack-infra | 20:16 | |
*** nherciu_ has quit IRC | 20:18 | |
*** salv-orlando has joined #openstack-infra | 20:18 | |
*** eranrom has quit IRC | 20:18 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Add scenario005 job (4nodes) https://review.openstack.org/418098 | 20:19 |
*** flepied has quit IRC | 20:20 | |
clarkb | alright I need to break for lunch but will be back in a bit to poke at it more. Haven't seen anything obviously wrong though | 20:20 |
openstackgerrit | Frédéric Guillot proposed openstack-infra/project-config: Disable identity v2 for Almanach gate https://review.openstack.org/418104 | 20:24 |
*** bknudson has joined #openstack-infra | 20:26 | |
serverascode | would anyone be willing to allow this change to add a new project in project-config? https://review.openstack.org/#/c/417522/ I have a ops team meeting in a couple days and it would be great to have that repo available for us to start working with | 20:27 |
*** ricardoas has quit IRC | 20:27 | |
AJaeger | serverascode: do you have any existing code that you want to import? | 20:28 |
*** mrtenio has quit IRC | 20:28 | |
serverascode | nope we don't | 20:28 |
AJaeger | serverascode: could you remove some extra whitespace at https://review.openstack.org/#/c/417522/3/zuul/layout.yaml , please? | 20:28 |
serverascode | AJaeger ok will do | 20:28 |
AJaeger | serverascode: thanks - I'll +2 afterwards | 20:29 |
*** zz_dimtruck is now known as dimtruck | 20:31 | |
openstackgerrit | Curtis Collicutt proposed openstack-infra/project-config: Add ops-telecom-nfv repository https://review.openstack.org/417522 | 20:32 |
AJaeger | serverascode: leave an empty line but without whitespace on it | 20:34 |
*** eranrom has joined #openstack-infra | 20:34 | |
serverascode | AJaeger oh ok sorry | 20:34 |
*** apetrich has quit IRC | 20:35 | |
*** apetrich has joined #openstack-infra | 20:36 | |
*** david-lyle has joined #openstack-infra | 20:37 | |
openstackgerrit | Curtis Collicutt proposed openstack-infra/project-config: Add ops-telecom-nfv repository https://review.openstack.org/417522 | 20:38 |
AJaeger | serverascode: LGTM, thanks for updating | 20:39 |
serverascode | AJaeger thank you | 20:39 |
AJaeger | pabelanger, rcarrillocruz, clarkb could you review https://review.openstack.org/#/c/417693 - to retire fairyslipper, please? Also, a review for a nit: https://review.openstack.org/417666 | 20:41 |
*** baoli has quit IRC | 20:41 | |
*** rbuzatu_ has quit IRC | 20:43 | |
*** srobert_ has joined #openstack-infra | 20:46 | |
*** srobert_ has quit IRC | 20:48 | |
*** srobert_ has joined #openstack-infra | 20:48 | |
*** srobert has quit IRC | 20:49 | |
openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci: WIP: Add OOOQ multinode test support https://review.openstack.org/416110 | 20:49 |
*** mrtenio has joined #openstack-infra | 20:50 | |
openstackgerrit | Merged openstack-infra/project-config: Don't use single item list for node in heat https://review.openstack.org/417666 | 20:50 |
*** ricardoas has joined #openstack-infra | 20:51 | |
*** eranrom has quit IRC | 20:51 | |
ianw | clarkb: looking | 20:51 |
openstackgerrit | Merged openstack-infra/tripleo-ci: Add "undecloud" or extra node's details to OVB's nodes' json https://review.openstack.org/413548 | 20:52 |
*** srobert has joined #openstack-infra | 20:53 | |
*** shardy has quit IRC | 20:53 | |
*** srobert has quit IRC | 20:53 | |
*** hichihara has joined #openstack-infra | 20:54 | |
*** dizquierdo has quit IRC | 20:55 | |
*** srobert_ has quit IRC | 20:56 | |
*** umeshksingla has quit IRC | 20:56 | |
*** lindycoder has joined #openstack-infra | 20:57 | |
*** umeshksingla has joined #openstack-infra | 20:57 | |
openstackgerrit | Merged openstack-infra/project-config: Run fedora platform job against devstack-gate https://review.openstack.org/418080 | 20:59 |
openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Handle provider removal from config https://review.openstack.org/418112 | 21:00 |
*** jamielennox|away is now known as jamielennox | 21:00 | |
*** baoli has joined #openstack-infra | 21:00 | |
*** timrc has quit IRC | 21:01 | |
openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Reduce our 3-node labels to min-ready 0 https://review.openstack.org/414714 | 21:02 |
AJaeger | pabelanger: rebased it manually for you ^ | 21:02 |
*** shamail has joined #openstack-infra | 21:02 | |
*** jaosorior has quit IRC | 21:03 | |
AJaeger | ianw, can you +2A https://review.openstack.org/414714 and https://review.openstack.org/417693 , please? Nothing urgent - whenever you have time... | 21:03 |
*** jaosorior has joined #openstack-infra | 21:03 | |
*** jlk has quit IRC | 21:06 | |
*** xarses has joined #openstack-infra | 21:06 | |
* AJaeger waves good night | 21:06 | |
*** bhunter71 has joined #openstack-infra | 21:08 | |
*** flepied has joined #openstack-infra | 21:08 | |
ianw | AJaeger: will do after some morning coffee :) good night | 21:10 |
*** rafaels has joined #openstack-infra | 21:10 | |
*** rafaelss has quit IRC | 21:13 | |
openstackgerrit | Ken Giusti proposed openstack-infra/project-config: Deprecate the amqp1 dsvm-functional test on centos 7 https://review.openstack.org/417971 | 21:14 |
*** denismakogon has joined #openstack-infra | 21:15 | |
*** tonytan4ever has quit IRC | 21:15 | |
shamail | Hi infra-team, is there a way to take over as chair of a meeting if the initial user got disconnected? | 21:16 |
*** tonytan4ever has joined #openstack-infra | 21:16 | |
fungi | shamail: only if they added you as an additional chair first | 21:16 |
shamail | fungi: they did not (this is for the meeting in openstack-3 right now) | 21:17 |
shamail | err | 21:17 |
shamail | openstack-alt | 21:17 |
shamail | sorry. | 21:17 |
fungi | shamail: options are to keep talking in hopes they show back up, or wait quietly for them to show back up. once an hour has elapsed from #startmeeting anyone (not only the chairs) can issue a #endmeeting | 21:18 |
*** dimtruck is now known as zz_dimtruck | 21:18 | |
fungi | you won't be able to officially change the topic, but can probably get by | 21:18 |
pabelanger | if CarolBarrett_ renames, should it work again? | 21:19 |
pabelanger | back to CarolBarrett | 21:19 |
fungi | yeah, all meetbot cares about is that the chair nick matches | 21:19 |
pabelanger | shamail: have the chair rename back to their original IRC nick | 21:19 |
pabelanger | commands should work again | 21:19 |
*** tonytan4ever has quit IRC | 21:20 | |
shamail | thanks fungi and pabelanger, ill ask Carol to change her nick | 21:20 |
*** tonytan4ever has joined #openstack-infra | 21:20 | |
*** dfflanders has joined #openstack-infra | 21:21 | |
*** hasharAway is now known as hashar | 21:26 | |
*** kgiusti has left #openstack-infra | 21:27 | |
shamail | That did the trick, thanks! | 21:27 |
fungi | glad to help | 21:27 |
*** wolverineav has joined #openstack-infra | 21:29 | |
*** wolverin_ has quit IRC | 21:30 | |
openstackgerrit | Umesh Kumar Singla proposed openstack-infra/jenkins-job-builder: Update Gradle plugin to use convert_mapping_to_xml function https://review.openstack.org/416377 | 21:30 |
*** flepied has quit IRC | 21:30 | |
*** ccamacho has quit IRC | 21:32 | |
openstackgerrit | Zara proposed openstack-infra/storyboard: Remove contentless operator manual https://review.openstack.org/418122 | 21:32 |
*** Jeffrey4l__ has joined #openstack-infra | 21:34 | |
*** Jeffrey4l_ has quit IRC | 21:35 | |
openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci: Use quickstart-extras checked out from zuul refs https://review.openstack.org/418123 | 21:36 |
openstackgerrit | Merged openstack-infra/project-config: Retire fairy-slipper (1/2) https://review.openstack.org/417693 | 21:36 |
*** rbrndt has quit IRC | 21:37 | |
*** rbrndt has joined #openstack-infra | 21:37 | |
clarkb | ianw: thanks for the review 418080 | 21:38 |
clarkb | ianw: I have rechecked https://review.openstack.org/#/c/417982/ to make sure it doesn't break on our fedora images | 21:39 |
*** tonytan4ever has quit IRC | 21:39 | |
*** adriant has joined #openstack-infra | 21:43 | |
*** fguillot has quit IRC | 21:44 | |
*** zz_dimtruck is now known as dimtruck | 21:44 | |
*** fguillot has joined #openstack-infra | 21:45 | |
*** eharney has quit IRC | 21:48 | |
*** rbuzatu has joined #openstack-infra | 21:48 | |
*** timrc has joined #openstack-infra | 21:49 | |
clarkb | ianw: and it looks like it worked fine so thats good to know | 21:50 |
ianw | cool | 21:51 |
*** jlk has joined #openstack-infra | 21:51 | |
*** jlk has quit IRC | 21:51 | |
*** jlk has joined #openstack-infra | 21:51 | |
ianw | yeah, f25 is on my today todo list | 21:51 |
*** rbuzatu has quit IRC | 21:53 | |
*** jaosorior has quit IRC | 21:53 | |
*** ihrachys has joined #openstack-infra | 21:54 | |
*** john-davidge has joined #openstack-infra | 21:55 | |
jhesketh | Morning | 21:55 |
clarkb | jhesketh: good morning. I status logged the tl;dr on fixing infra chocolate | 21:55 |
*** burgerk has joined #openstack-infra | 21:55 | |
jhesketh | clarkb: yep just reading the scroll back. Thanks for that | 21:56 |
openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci: Install openstackclient on te-broker https://review.openstack.org/418129 | 21:58 |
*** john-davidge has quit IRC | 21:59 | |
*** fguillot has quit IRC | 22:01 | |
jeblair | it's zuul meeting time in #openstack-meeting-alt | 22:01 |
*** shamail has quit IRC | 22:02 | |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Source glean installs in simple-init https://review.openstack.org/414662 | 22:02 |
*** hichihara has quit IRC | 22:03 | |
*** trown is now known as trown|outtypewww | 22:04 | |
*** jcoufal has quit IRC | 22:05 | |
*** Goneri has quit IRC | 22:09 | |
*** adrian_otto has quit IRC | 22:10 | |
*** jheroux has quit IRC | 22:11 | |
*** rcernin has quit IRC | 22:12 | |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Remove the ability for nodepoold to launch a builder https://review.openstack.org/418137 | 22:18 |
openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Remove the ability for nodepoold to launch a builder https://review.openstack.org/418137 | 22:19 |
*** mixos has joined #openstack-infra | 22:19 | |
ianw | pabelanger: speaking of builders, i'd like to get push notifications going again for builds, if you get a chance to look at https://review.openstack.org/#/c/413874/ (json output for build status) that would help. won't be a stretch to script that into a quick cron checker | 22:20 |
*** mattoliverau has quit IRC | 22:21 | |
*** matt6434 has joined #openstack-infra | 22:21 | |
*** baoli has quit IRC | 22:21 | |
*** matt6434 is now known as mattoliverau | 22:22 | |
*** mriedem has joined #openstack-infra | 22:22 | |
*** salv-orl_ has joined #openstack-infra | 22:23 | |
*** darrenc is now known as darrenc_afk | 22:23 | |
*** salv-orlando has quit IRC | 22:26 | |
*** wolverineav has quit IRC | 22:26 | |
*** duartea__ has quit IRC | 22:27 | |
*** wolverineav has joined #openstack-infra | 22:27 | |
*** duartea__ has joined #openstack-infra | 22:27 | |
*** wolverineav has quit IRC | 22:27 | |
*** matt-borland has quit IRC | 22:28 | |
*** wolverineav has joined #openstack-infra | 22:31 | |
*** mixos has quit IRC | 22:33 | |
*** spzala has quit IRC | 22:34 | |
*** wolverineav has quit IRC | 22:35 | |
*** salv-orl_ has quit IRC | 22:36 | |
*** salv-orlando has joined #openstack-infra | 22:37 | |
*** denismakogon has quit IRC | 22:38 | |
*** jamesdenton has quit IRC | 22:41 | |
*** adrian_otto has joined #openstack-infra | 22:42 | |
*** wolverineav has joined #openstack-infra | 22:43 | |
*** tnovacik has quit IRC | 22:46 | |
*** wolverineav has quit IRC | 22:47 | |
jeblair | ianw: +2 with comment | 22:50 |
*** xyang1 has quit IRC | 22:50 | |
*** burgerk_ has joined #openstack-infra | 22:52 | |
ianw | jeblair: would you think a direct pass-through of toDict() to basically json? i'm thinking how we generate the "id" and that maybe it's more flexible to have that shim layer | 22:54 |
*** Swami has joined #openstack-infra | 22:54 | |
*** Swami_ has joined #openstack-infra | 22:55 | |
*** burgerk has quit IRC | 22:55 | |
*** umeshksingla has quit IRC | 22:56 | |
Shrews | ianw: i left a -1 with a comment :) | 22:57 |
*** panda is now known as panda|zZ | 22:57 | |
*** burgerk_ has quit IRC | 22:57 | |
jeblair | ianw: yeah, i think that along with having the presentation decoupled from the internal data structure so that we aren't surprised by exposing new fields in the future are good reasons for the shim (otoh, we don't automatically expose new fields :) | 22:57 |
ianw | Shrews: cool, i'll look at that | 22:58 |
*** david-lyle has quit IRC | 22:59 | |
*** newmember has joined #openstack-infra | 22:59 | |
Shrews | ianw: i could be off base on what you want, but when i say "won't have certain attributes", i meant "they could have no values". if that's ok, i'll retract my -1 | 22:59 |
Shrews | i was thinking you only wanted valid builds | 23:00 |
*** darrenc_afk is now known as darrenc | 23:00 | |
*** wolverineav has joined #openstack-infra | 23:00 | |
jeblair | Shrews, ianw: yeah, i think we want the whole set there -- it does the same thing as the prettytable version above | 23:00 |
jeblair | whole set == all of the builds regardless of state | 23:01 |
ianw | Shrews: well, what I used to do was get the latest build log on nodepool.o.o for each build, download it and scrape the output looking for failure/success | 23:01 |
ianw | it worked better than you might think :) | 23:01 |
*** baoli has joined #openstack-infra | 23:01 | |
*** baoli has quit IRC | 23:01 | |
Shrews | jeblair: ianw: ah, well if you want the entire set, that's fine. but we have api methods for getting the most recent builds (which is what you mention in the commit msg) | 23:01 |
ianw | yeah, it's actually mostly about failures, so i get my daily "everything's on fire" message :0 | 23:02 |
Shrews | ianw: sounds like you need everything. i'll change my vote then :) | 23:02 |
*** florianf has quit IRC | 23:03 | |
jeblair | ianw: https://simpsonswiki.com/wiki/Everything's_OK_alarm | 23:03 |
*** rafaels has quit IRC | 23:05 | |
ianw | heh, it's kind of the dream to have that going off :) | 23:05 |
*** jaosorior has joined #openstack-infra | 23:07 | |
ianw | i'm thinking with this that we can ship a nice generic-ish bootstrap html page with nodepool (just keep it in a contrib/ type location) which we can deploy as the landing page for nodepool.openstack.org | 23:07 |
*** gildub has joined #openstack-infra | 23:08 | |
ianw | rather than having nodepool serving it all up | 23:08 |
fungi | i'm also fond of the inverse, the "PROBLEM" light from http://venturebrothers.wikia.com/wiki/Careers_in_Science | 23:09 |
*** EricGonczer_ has quit IRC | 23:10 | |
*** pradk has quit IRC | 23:10 | |
fungi | (extent of the diagnostic interface on the space station was a singular blinking light) | 23:10 |
*** sdake has quit IRC | 23:11 | |
*** mixos has joined #openstack-infra | 23:11 | |
*** asettle has joined #openstack-infra | 23:12 | |
ianw | sounds like the ancient ibm mainframe for the billing department of a job i had long ago | 23:12 |
jeblair | Note: Should the 'PROBLEM' light activate, the condition can be resolved by performing corrective action. | 23:13 |
ianw | i remember some poor operator sitting there in the freezing ac with a giant folder on his lap trying to decode some problem light | 23:13 |
jeblair | (see also: "Check engine soon") | 23:14 |
*** mixos has quit IRC | 23:15 | |
*** lindycoder has quit IRC | 23:16 | |
*** pradk has joined #openstack-infra | 23:21 | |
*** mriedem has quit IRC | 23:22 | |
*** asettle has quit IRC | 23:22 | |
*** wolverineav has quit IRC | 23:23 | |
*** asettle has joined #openstack-infra | 23:23 | |
*** sdake has joined #openstack-infra | 23:26 | |
*** vhosakot has quit IRC | 23:26 | |
*** asettle has quit IRC | 23:27 | |
*** sdake has quit IRC | 23:28 | |
*** sdake has joined #openstack-infra | 23:29 | |
openstackgerrit | Merged openstack-infra/devstack-gate: Add save_* functions for clearer saving of artifacts https://review.openstack.org/334504 | 23:31 |
*** thorst has quit IRC | 23:32 | |
*** aeng has quit IRC | 23:32 | |
*** thorst has joined #openstack-infra | 23:32 | |
*** wolverineav has joined #openstack-infra | 23:35 | |
*** salv-orlando has quit IRC | 23:35 | |
*** thorst has quit IRC | 23:37 | |
*** Julien-zte has quit IRC | 23:38 | |
*** gordc has quit IRC | 23:38 | |
*** wolverineav has quit IRC | 23:39 | |
*** spzala has joined #openstack-infra | 23:40 | |
*** harlowja_ has quit IRC | 23:40 | |
*** jaosorior has quit IRC | 23:40 | |
*** harlowja has joined #openstack-infra | 23:41 | |
*** marst has quit IRC | 23:42 | |
*** lihi has quit IRC | 23:43 | |
*** lihi has joined #openstack-infra | 23:43 | |
*** umeshksingla has joined #openstack-infra | 23:44 | |
*** stakeda has joined #openstack-infra | 23:44 | |
*** mminesh has quit IRC | 23:45 | |
*** mminesh has joined #openstack-infra | 23:45 | |
*** aeng has joined #openstack-infra | 23:46 | |
*** salv-orlando has joined #openstack-infra | 23:48 | |
*** ianychoi has joined #openstack-infra | 23:49 | |
*** mdrabe has quit IRC | 23:51 | |
*** inc0 has quit IRC | 23:52 | |
*** salv-orlando has quit IRC | 23:53 | |
clarkb | sdague: ^ there you go | 23:54 |
*** wolverineav has joined #openstack-infra | 23:54 | |
*** palendae has left #openstack-infra | 23:56 | |
*** rbrndt has quit IRC | 23:58 | |
openstackgerrit | Hongbin Lu proposed openstack-infra/project-config: Fuxi: get python35 jobs voting https://review.openstack.org/418157 | 23:58 |
*** wolverineav has quit IRC | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!