| *** dims has quit IRC | 00:03 | |
| *** dims has joined #openstack-qa | 00:03 | |
| *** gordc has quit IRC | 00:05 | |
| *** dims has quit IRC | 00:08 | |
| *** toure has quit IRC | 00:08 | |
| *** david-lyle is now known as david-lyle_afk | 00:17 | |
| *** rushiagr_away is now known as rushiagr | 00:17 | |
| *** mlavalle has quit IRC | 00:17 | |
| *** dims has joined #openstack-qa | 00:21 | |
| *** markmcclain has quit IRC | 00:23 | |
| JayF | I have https://review.openstack.org/#/c/136867/2/lib/ironic,cm tested working locally, would love to get it in to help troubleshoot any agent_ssh failures in devstack | 00:24 |
|---|---|---|
| *** jhenner has quit IRC | 00:24 | |
| JayF | On another note; has there ever been investigation into making the ironic-bm-logs/baremetalbrbm_*_console.log files not clear on reboot? | 00:24 |
| JayF | because if there was an issue imaging an instance and it got far enough to reboot; it'd completely kill any logs from the Ironic Python Agent | 00:25 |
| JayF | adam_g: ^ | 00:25 |
| adam_g | JayF, yeah actually i started workig on a patch set to do that | 00:26 |
| JayF | adam_g: you see my change? (136867 linked above) | 00:26 |
| JayF | adam_g: makes anything from inside the ramdisk log to console; I verified locally it worked and it looked great | 00:26 |
| JayF | adam_g: not the easiest logs to parse because it basically funnels everything through kmsg, but it's better than no logs and is a very small change | 00:27 |
| adam_g | JayF, cool | 00:27 |
| adam_g | JayF, so i started this a while ago, i need to dust it off https://review.openstack.org/#/c/129099/ | 00:27 |
| *** rushiagr is now known as rushiagr_away | 00:28 | |
| JayF | dtroyer: if you have a chance, https://review.openstack.org/#/c/136867 is awaiting a +2A and you were reccomended to me as a friendly person who is kind and reviews with ferocity :P | 00:28 |
| *** markmcclain has joined #openstack-qa | 00:28 | |
| adam_g | JayF, works fine if youre using screen (new screen tabs to monitor each log) but not so much when screen is disabled. need a good way to launch that procescs in the bg | 00:28 |
| JayF | wait, those logs are in screen somewhere? | 00:29 |
| * JayF looks | 00:29 | |
| JayF | adam_g: not /yet/ you mean, just in that change? | 00:29 |
| adam_g | JayF, no, with that patch--it'll spawn processes in screen, to monitor the console log and preserve stuff that'd be truncated | 00:29 |
| JayF | won't that fix the gate issue then? | 00:30 |
| adam_g | JayF, but we dont use screen in the gate jobs, so its kinda useless | 00:30 |
| JayF | adam_g: there are logs *labelled* screen in teh gate? | 00:30 |
| *** dims has quit IRC | 00:31 | |
| adam_g | JayF, yeah--i dont know why those are labeled like that, they run USE_SCREEN=False | 00:31 |
| *** dims has joined #openstack-qa | 00:31 | |
| JayF | Would be nice to see if clarkb or those guys had any advice on that patch then | 00:32 |
| clarkb | because they were run with screen for like 2 years | 00:32 |
| clarkb | I would not rename them to rename them | 00:32 |
| JayF | because that's going to pretty much required to figure out when IPA starts breaking jobs | 00:32 |
| JayF | which will happen, eventually, in the IPA pipeline only (hopefully) | 00:32 |
| clarkb | it would be something to do as part of the larger break the world service renaming | 00:32 |
| adam_g | clarkb, makes sense | 00:33 |
| JayF | any advice for me or adam_g on persisting those ironic-bm-logs then? | 00:33 |
| *** melwitt has quit IRC | 00:33 | |
| clarkb | can't you do it like all the other? | 00:34 |
| adam_g | JayF, we just need to spawn a background process to 'wait for console log to exist && start tailing console log to a new persistent log file' i need to play with that patch more, spawning that with the facilities offered by devstack is tricky | 00:34 |
| adam_g | clarkb, we setup libvirt to log VM console output to a file, but that file is truncated every time theres a power cycle, so we lose lots context unless the last test to run failed | 00:35 |
| JayF | adam_g: or even if the last test failed; if the provision got far enough for ironic to reboot the node the data is gone | 00:36 |
| clarkb | libvirt doesn't have an append mode? | 00:36 |
| *** dmorita has joined #openstack-qa | 00:36 | |
| adam_g | JayF, yeah | 00:36 |
| *** dims has quit IRC | 00:36 | |
| adam_g | clarkb, not that i know of ? | 00:36 |
| *** mpavlase has quit IRC | 00:40 | |
| *** david-lyle_afk has quit IRC | 00:45 | |
| gmann | coolsvap: ping | 00:55 |
| *** toure has joined #openstack-qa | 01:02 | |
| *** salv-orlando has quit IRC | 01:04 | |
| *** marun has joined #openstack-qa | 01:08 | |
| *** ranger81 has quit IRC | 01:08 | |
| *** ranger81 has joined #openstack-qa | 01:09 | |
| *** catohornet has joined #openstack-qa | 01:10 | |
| *** topshare has joined #openstack-qa | 01:11 | |
| *** adalbas has quit IRC | 01:13 | |
| *** wuhg has joined #openstack-qa | 01:14 | |
| *** jecarey has joined #openstack-qa | 01:23 | |
| *** weshay has joined #openstack-qa | 01:34 | |
| *** yamamoto has quit IRC | 01:36 | |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: Set up ssh_known_host based on hostname https://review.openstack.org/136596 | 01:38 |
| jogo | mtreinish: I think you had the right idea, just used tr in the wrong place ^ | 01:38 |
| jogo | I tried echo foo `remote_command chatty hostname | tr -d '\r'` locally and it looks better | 01:39 |
| *** dims has joined #openstack-qa | 01:42 | |
| *** toure has quit IRC | 01:43 | |
| *** toure has joined #openstack-qa | 01:46 | |
| *** achanda has quit IRC | 01:50 | |
| *** ranger81 has quit IRC | 01:51 | |
| *** weshay has quit IRC | 01:54 | |
| *** ranger81_ has joined #openstack-qa | 01:55 | |
| *** catohornet has quit IRC | 01:59 | |
| *** dims has quit IRC | 02:00 | |
| *** dims has joined #openstack-qa | 02:00 | |
| *** nosnos has joined #openstack-qa | 02:01 | |
| *** dims has quit IRC | 02:05 | |
| *** jecarey has quit IRC | 02:08 | |
| openstackgerrit | Adam Gandelman proposed openstack-dev/devstack: Spawn console log monitors for Ironic VM nodes https://review.openstack.org/129099 | 02:09 |
| adam_g | JayF, that might work ^ | 02:09 |
| *** yamamoto has joined #openstack-qa | 02:09 | |
| *** shashankhegde has quit IRC | 02:13 | |
| openstackgerrit | huangtianhua proposed openstack/tempest: Take InstanceType for launchconfig res creation https://review.openstack.org/135519 | 02:17 |
| *** catohornet has joined #openstack-qa | 02:18 | |
| *** dkranz has joined #openstack-qa | 02:28 | |
| *** chandankumar has joined #openstack-qa | 02:32 | |
| *** patrickeast has quit IRC | 02:40 | |
| *** dkranz has quit IRC | 02:40 | |
| *** esmute has quit IRC | 02:44 | |
| *** catohornet has quit IRC | 02:45 | |
| *** mrodden has quit IRC | 02:46 | |
| *** jyuso has quit IRC | 02:53 | |
| *** mrodden has joined #openstack-qa | 02:56 | |
| *** yamahata has joined #openstack-qa | 02:57 | |
| *** chandankumar has quit IRC | 03:02 | |
| *** chandankumar has joined #openstack-qa | 03:03 | |
| *** ranger81_ has quit IRC | 03:09 | |
| *** JayJ has joined #openstack-qa | 03:28 | |
| *** chandankumar has quit IRC | 03:28 | |
| *** nosnos has quit IRC | 03:29 | |
| *** JayJ has quit IRC | 03:33 | |
| openstackrecheck | Console logs not available after 14:23s for check-tempest-dsvm-neutron-full 136456,4,3939062 | 03:33 |
| *** bkopilov has quit IRC | 03:38 | |
| *** dpaterson has quit IRC | 03:38 | |
| *** markmcclain has quit IRC | 03:42 | |
| *** tiantian has joined #openstack-qa | 03:43 | |
| tiantian | cyeoh: hi | 03:43 |
| *** tiantian is now known as huangtianhua | 03:46 | |
| huangtianhua | cyeoh: hi, would you please to review the patch https://review.openstack.org/#/c/135519/ | 03:47 |
| *** nosnos has joined #openstack-qa | 04:03 | |
| openstackgerrit | Jamie Lennox proposed openstack-dev/devstack: Use new cafile option in nova cinder options https://review.openstack.org/136960 | 04:06 |
| openstackgerrit | Jamie Lennox proposed openstack-dev/devstack: Use the service catalog when talking to cinder https://review.openstack.org/136961 | 04:06 |
| openstackrecheck | Console logs not available after 13:33s for check-grenade-dsvm 134347,4,5bd0bac | 04:10 |
| *** shashankhegde has joined #openstack-qa | 04:13 | |
| *** tochi has joined #openstack-qa | 04:15 | |
| openstackrecheck | openstack/nova change: https://review.openstack.org/131490 failed because of: gate-grenade-dsvm-partial-ncpu: https://bugs.launchpad.net/bugs/1373513 | 04:16 |
| jogo | mtreinish: woot it worked! | 04:19 |
| jogo | mtreinish: tr FTW | 04:20 |
| *** OmPrakashPandey has joined #openstack-qa | 04:35 | |
| *** oomichi has quit IRC | 04:38 | |
| *** toure has quit IRC | 04:38 | |
| *** Madan has joined #openstack-qa | 04:40 | |
| *** subscope_ has joined #openstack-qa | 04:55 | |
| openstackgerrit | Merged openstack/tempest: Add Conflict exception in test_floating_ips_actions case https://review.openstack.org/131364 | 04:58 |
| openstackgerrit | Merged openstack/tempest: Update documentation for clarity https://review.openstack.org/135737 | 04:59 |
| *** esmute has joined #openstack-qa | 05:04 | |
| openstackgerrit | Merged openstack/qa-specs: Add spec for clients returning one value https://review.openstack.org/126004 | 05:11 |
| *** jamielennox has quit IRC | 05:11 | |
| *** jamielennox has joined #openstack-qa | 05:11 | |
| *** anshul has joined #openstack-qa | 05:13 | |
| *** bkopilov has joined #openstack-qa | 05:14 | |
| *** ranger81 has joined #openstack-qa | 05:18 | |
| *** chandankumar has joined #openstack-qa | 05:25 | |
| *** subscope_ has quit IRC | 05:25 | |
| openstackgerrit | Merged openstack-infra/subunit2sql: Flush out the db api documenation https://review.openstack.org/129405 | 05:27 |
| openstackgerrit | Merged openstack-infra/subunit2sql: Reorganize the python api documentation https://review.openstack.org/129406 | 05:27 |
| openstackgerrit | Merged openstack-infra/subunit2sql: Add section on the basic data model https://review.openstack.org/129407 | 05:29 |
| *** nosnos has quit IRC | 05:30 | |
| *** nosnos_ has joined #openstack-qa | 05:30 | |
| *** oomichi has joined #openstack-qa | 05:32 | |
| *** ranger81 has quit IRC | 05:41 | |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: DO NOT MERGE: pulling in unmerged devstack patch https://review.openstack.org/136504 | 05:53 |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: Set up ssh_known_host based on hostname https://review.openstack.org/136596 | 05:53 |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: Setup /etc/hosts for aiopcpu https://review.openstack.org/136158 | 05:53 |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: DO NOT COMMIT disable config drive https://review.openstack.org/135831 | 05:53 |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: DO NOT MERGE: testing aiopcpu with tempest full https://review.openstack.org/134639 | 05:53 |
| openstackrecheck | openstack/tempest change: https://review.openstack.org/134889 failed gate-grenade-dsvm-partial-ncpu in the gate queue with an unrecognized error | 05:56 |
| chandankumar | gmann, good morning :) | 05:57 |
| *** shashankhegde has quit IRC | 05:58 | |
| gmann | chandankumar: gm | 06:01 |
| *** shashankhegde has joined #openstack-qa | 06:02 | |
| chandankumar | gmann, http://logs.openstack.org/89/134889/4/gate/gate-grenade-dsvm-partial-ncpu/d5a710d | 06:03 |
| chandankumar | gmann, the jenkin gate is failing, i have added a recheck. | 06:03 |
| gmann | chandankumar: i did not find any failure related to patch changes. | 06:07 |
| gmann | let's see recheck results | 06:07 |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: DO NOT MERGE: testing aiopcpu with tempest full https://review.openstack.org/136504 | 06:10 |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: Set up ssh_known_host based on hostname https://review.openstack.org/136596 | 06:10 |
| *** shashankhegde has quit IRC | 06:10 | |
| *** shashankhegde has joined #openstack-qa | 06:14 | |
| *** rushiagr_away is now known as rushiagr | 06:19 | |
| *** jyuso has joined #openstack-qa | 06:23 | |
| *** k4n0 has joined #openstack-qa | 06:24 | |
| *** vigneshvar has joined #openstack-qa | 06:25 | |
| *** vigneshvar has quit IRC | 06:33 | |
| *** nosnos_ has quit IRC | 06:34 | |
| *** nosnos has joined #openstack-qa | 06:34 | |
| openstackrecheck | openstack/glance change: https://review.openstack.org/132113 failed because of: gate-tempest-dsvm-full: https://bugs.launchpad.net/bugs/1373513 https://bugs.launchpad.net/bugs/1348204 https://bugs.launchpad.net/bugs/1352498 | 06:35 |
| *** neeti has joined #openstack-qa | 06:35 | |
| *** nmagnezi has joined #openstack-qa | 06:39 | |
| *** shashankhegde has quit IRC | 06:40 | |
| *** Longgeek has joined #openstack-qa | 06:42 | |
| *** Longgeek has quit IRC | 06:42 | |
| *** Longgeek has joined #openstack-qa | 06:42 | |
| *** shashankhegde has joined #openstack-qa | 06:45 | |
| *** shashankhegde has quit IRC | 06:47 | |
| *** SridharG has joined #openstack-qa | 06:48 | |
| *** harlowja is now known as harlowja_away | 07:01 | |
| *** Longgeek has quit IRC | 07:01 | |
| *** Longgeek has joined #openstack-qa | 07:02 | |
| *** Longgeek has quit IRC | 07:06 | |
| *** achanda has joined #openstack-qa | 07:08 | |
| openstackgerrit | Sergey Shnaidman proposed openstack/tempest: Test delete of SLAAC subnet without port delete https://review.openstack.org/136909 | 07:11 |
| *** Longgeek has joined #openstack-qa | 07:14 | |
| *** yfried has joined #openstack-qa | 07:24 | |
| yfried | sergsh: about https://review.openstack.org/#/c/136789/ | 07:28 |
| chandankumar | gmann, it is still failing and 4 jobs are not able to run: https://review.openstack.org/134889 | 07:28 |
| chandankumar | please have a look | 07:28 |
| yfried | sergsh: I'd like to help you run it, cause I'd like more practical eyes on that test | 07:28 |
| *** achanda has quit IRC | 07:35 | |
| *** e0ne has joined #openstack-qa | 07:40 | |
| *** achanda has joined #openstack-qa | 07:43 | |
| openstackgerrit | Yair Fried proposed openstack/tempest: Cleanup class resources for large-ops scenario https://review.openstack.org/136981 | 07:44 |
| *** achanda has quit IRC | 07:46 | |
| *** achanda has joined #openstack-qa | 07:48 | |
| *** jamielennox is now known as jamielennox|away | 07:49 | |
| *** obondarev_ has joined #openstack-qa | 07:51 | |
| *** e0ne has quit IRC | 07:53 | |
| *** achanda has quit IRC | 07:53 | |
| *** pkoniszewski has joined #openstack-qa | 07:57 | |
| *** e0ne has joined #openstack-qa | 07:57 | |
| *** pkonisze has joined #openstack-qa | 07:58 | |
| *** achanda has joined #openstack-qa | 07:58 | |
| *** e0ne has quit IRC | 07:59 | |
| *** pkoniszewski has quit IRC | 08:01 | |
| *** e0ne has joined #openstack-qa | 08:03 | |
| *** salv-orlando has joined #openstack-qa | 08:08 | |
| *** e0ne has quit IRC | 08:08 | |
| *** achanda has quit IRC | 08:10 | |
| *** e0ne has joined #openstack-qa | 08:12 | |
| *** ci-testing has quit IRC | 08:14 | |
| *** btran has joined #openstack-qa | 08:14 | |
| *** qba73 has joined #openstack-qa | 08:16 | |
| *** markus_z has joined #openstack-qa | 08:16 | |
| *** yamamoto has quit IRC | 08:18 | |
| *** e0ne has quit IRC | 08:18 | |
| openstackgerrit | Udi Kalifon proposed openstack/tempest: Support creating users with a default_project_id https://review.openstack.org/135922 | 08:21 |
| *** tkammer has joined #openstack-qa | 08:24 | |
| *** afazekas has joined #openstack-qa | 08:34 | |
| *** OmPrakashPandey has quit IRC | 08:39 | |
| *** eezhova has quit IRC | 08:40 | |
| *** OmPrakashPandey has joined #openstack-qa | 08:40 | |
| *** eezhova has joined #openstack-qa | 08:41 | |
| *** jlanoux has joined #openstack-qa | 08:42 | |
| *** ranger81 has joined #openstack-qa | 08:42 | |
| *** safchain has joined #openstack-qa | 08:43 | |
| *** OmPrakashPandey has quit IRC | 08:45 | |
| *** ranger81 has quit IRC | 08:46 | |
| *** matrohon has joined #openstack-qa | 08:52 | |
| *** jpich has joined #openstack-qa | 09:01 | |
| *** obondarev_ is now known as obondarev | 09:06 | |
| *** yamamoto has joined #openstack-qa | 09:11 | |
| *** yamahata has quit IRC | 09:11 | |
| *** svasheka has quit IRC | 09:11 | |
| *** adalbas has joined #openstack-qa | 09:14 | |
| *** topshare has quit IRC | 09:18 | |
| *** yamamoto has quit IRC | 09:18 | |
| *** adalbas has quit IRC | 09:21 | |
| *** andreykurilin_ has joined #openstack-qa | 09:22 | |
| *** avico has joined #openstack-qa | 09:22 | |
| *** jordanP has joined #openstack-qa | 09:23 | |
| *** yfried is now known as yfried|afk | 09:24 | |
| *** nmagnezi has quit IRC | 09:25 | |
| *** yfried|afk is now known as yfried | 09:25 | |
| *** e0ne has joined #openstack-qa | 09:25 | |
| *** OmPrakashPandey has joined #openstack-qa | 09:27 | |
| *** luqas has joined #openstack-qa | 09:27 | |
| *** oomichi has quit IRC | 09:33 | |
| *** nmagnezi has joined #openstack-qa | 09:38 | |
| sergsh | yfried, np, will run | 09:41 |
| yfried | sergsh: I should put this in comments, but you need to disable nova and neutron quotas, as well as set a large enough subnet CIDR in tempest.conf/network section | 09:42 |
| *** zz_johnthetubagu is now known as johnthetubaguy | 09:44 | |
| sergsh | yfried, the default cidr is not good? | 09:46 |
| openstackgerrit | Jordan Pittier proposed openstack/tempest: Scenario manager: catch Exception in get_remote_client https://review.openstack.org/134914 | 09:46 |
| chandankumar | afazekas, hello | 09:46 |
| openstackgerrit | Sergey Shnaidman proposed openstack/tempest: Test delete of SLAAC subnet without port delete https://review.openstack.org/136909 | 09:47 |
| afazekas | chandankumar, hi | 09:47 |
| chandankumar | afazekas, pleae have a look why jenkins are failing on this review https://review.openstack.org/#/c/134889/ | 09:48 |
| chandankumar | *please | 09:48 |
| *** nfedotov has joined #openstack-qa | 09:48 | |
| yfried | sergsh: it's using /28 mask. I think | 09:50 |
| yfried | sergsh: not sure | 09:50 |
| yfried | sergsh: you need the CIDR to allow for creation of large_ops number | 09:51 |
| sergsh | ok | 09:51 |
| *** aix has quit IRC | 09:51 | |
| *** andreykurilin_ has quit IRC | 10:00 | |
| *** andreykurilin_ has joined #openstack-qa | 10:00 | |
| *** salv-orlando has quit IRC | 10:00 | |
| *** salv-orlando has joined #openstack-qa | 10:02 | |
| openstackgerrit | Merged openstack-dev/devstack: Enable admin mode by default https://review.openstack.org/136803 | 10:03 |
| *** topshare has joined #openstack-qa | 10:05 | |
| *** topshare has quit IRC | 10:05 | |
| *** mpavlase has joined #openstack-qa | 10:05 | |
| *** andreykurilin_ has quit IRC | 10:05 | |
| *** topshare has joined #openstack-qa | 10:05 | |
| *** andreykurilin_ has joined #openstack-qa | 10:06 | |
| *** nosnos has quit IRC | 10:08 | |
| *** nosnos has joined #openstack-qa | 10:09 | |
| afazekas | chandankumar, cirros boot stopped at 'info: initramfs: up at 3.11' line | 10:10 |
| openstackgerrit | Merged openstack-dev/devstack: Restore linuxbridge-agent compatibility https://review.openstack.org/136494 | 10:11 |
| afazekas | chandankumar, Are you asking about the 'NOT_REGISTERED' ? | 10:12 |
| afazekas | chandankumar: looks like other people also get this response from Jenkins. It is some kind of infra/ config issue. | 10:15 |
| afazekas | The #openstack-infra channel is better for speaking about these kind of issues | 10:16 |
| *** aix has joined #openstack-qa | 10:17 | |
| openstackgerrit | Yuiko Takada proposed openstack-dev/devstack: add the kernel/ramdisk id to driver_info https://review.openstack.org/135897 | 10:19 |
| *** yamamoto has joined #openstack-qa | 10:19 | |
| *** yfried is now known as yfried|afk | 10:22 | |
| *** dmorita has quit IRC | 10:23 | |
| *** yamamoto has quit IRC | 10:24 | |
| openstackgerrit | jun xie proposed openstack/tempest: add cinder v2 api tests for volume_services https://review.openstack.org/135860 | 10:29 |
| *** jlanoux_ has joined #openstack-qa | 10:31 | |
| *** jlanoux has quit IRC | 10:34 | |
| *** mpaolino has joined #openstack-qa | 10:37 | |
| *** topshare has quit IRC | 10:37 | |
| *** jhenner has joined #openstack-qa | 10:37 | |
| *** vigneshvar has joined #openstack-qa | 10:41 | |
| kashyap | afazekas, Hi, After a successful DevStack run, I always see most of the projects' requirements.txt/test-requirements.txt files modified, e.g. bumping up eventlet version change, etc. Can this be avoided somehow I wonder | 10:42 |
| *** yfried|afk is now known as yfried | 10:42 | |
| chandankumar | afazekas, asking the same on infra. | 10:44 |
| *** jlanoux has joined #openstack-qa | 10:45 | |
| *** jlanoux_ has quit IRC | 10:48 | |
| yfried | afazekas: do you know where AndreaF is? | 10:52 |
| afazekas | yfried: Usually close to our TZ, I do not know where is he at the moment | 10:54 |
| yfried | afazekas: he's been offline since Paris. I was wondering if he's on vacation and when he's coming back | 10:55 |
| jlanoux | yfried: AndreaF is on holiday until the 29th | 10:56 |
| yfried | jlanoux: tnx | 10:57 |
| *** salv-orlando has quit IRC | 10:57 | |
| yfried | jlanoux: guess I'll ping him next week | 10:57 |
| jlanoux | yfried: np | 10:58 |
| *** avico has quit IRC | 11:00 | |
| *** salv-orlando has joined #openstack-qa | 11:02 | |
| yfried | jogo: ping | 11:02 |
| *** luqas has quit IRC | 11:03 | |
| yfried | afazekas: what does NOT_REGISTERED means for Jenkins results in gate? | 11:06 |
| *** X019 has joined #openstack-qa | 11:08 | |
| *** gszasz has joined #openstack-qa | 11:08 | |
| *** tosky has joined #openstack-qa | 11:09 | |
| *** salv-orlando has quit IRC | 11:11 | |
| *** salv-orlando has joined #openstack-qa | 11:11 | |
| openstackgerrit | Abhishek G M proposed openstack/tempest: Test to verify shared attribute of network https://review.openstack.org/124998 | 11:12 |
| *** andreykurilin_ has quit IRC | 11:12 | |
| *** avico has joined #openstack-qa | 11:13 | |
| afazekas | yfried: maybe miss config in https://github.com/openstack-infra/project-config | 11:15 |
| *** rfolco has joined #openstack-qa | 11:16 | |
| *** luqas has joined #openstack-qa | 11:17 | |
| *** aix has quit IRC | 11:18 | |
| *** k4n0 has quit IRC | 11:20 | |
| *** dims has joined #openstack-qa | 11:20 | |
| *** yfried has quit IRC | 11:20 | |
| *** rfolco has quit IRC | 11:20 | |
| *** mpavlase has left #openstack-qa | 11:20 | |
| *** yamamoto has joined #openstack-qa | 11:21 | |
| *** yfried has joined #openstack-qa | 11:22 | |
| *** avico has quit IRC | 11:22 | |
| *** avico has joined #openstack-qa | 11:25 | |
| afazekas | yfried: try #openstack-infra I do not know what causes it | 11:26 |
| *** vigneshvar has quit IRC | 11:27 | |
| openstackrecheck | openstack/nova change: https://review.openstack.org/134598 failed gate-tempest-dsvm-neutron-full in the gate queue with an unrecognized error | 11:28 |
| *** vigneshvar has joined #openstack-qa | 11:30 | |
| *** aix has joined #openstack-qa | 11:31 | |
| *** yfried is now known as yfried|afk | 11:35 | |
| *** aysyd has joined #openstack-qa | 11:37 | |
| *** jhenner has quit IRC | 11:37 | |
| sergsh | what should I do if tested feature is only in Kilo, not in Juno? | 11:39 |
| *** yfried|afk is now known as yfried | 11:40 | |
| yfried | sergsh: what do you mean? you found a bug in kilo? | 11:40 |
| sergsh | yfried, no, I mean some bug was resolved in Kilo, I wrote test for it, but it fails on Jenkins jobs for juno | 11:41 |
| sergsh | so it's impossible to push it to upstream | 11:41 |
| yfried | sergsh: I had the same problem with icehouse last week | 11:42 |
| *** pkonisze has quit IRC | 11:42 | |
| yfried | sergsh: the obvious, easy and long solution is to ask for a back port | 11:43 |
| yfried | sergsh: the quick and dirty is to add a conf flag for a skip | 11:43 |
| yfried | sergsh: and then edit devstack-gate | 11:43 |
| *** yamamoto has quit IRC | 11:44 | |
| sergsh | yfried, yeah, it seems the same problem as yours, maybe version flag is good idea anyway | 11:44 |
| yfried | sergsh: well, afazekas said (and I agree) that a version flag goes against the standard practice in tempest | 11:45 |
| yfried | sergsh: a feature-specific flag is better | 11:45 |
| yfried | sergsh: but a backport request is easiest | 11:45 |
| sergsh | and how is backporting going? I don't know about it much) | 11:46 |
| yfried | sergsh: where is the bug? | 11:48 |
| sergsh | neutron | 11:48 |
| afazekas | sergsh: do you have to the fixing change ? | 11:48 |
| *** vigneshvar has quit IRC | 11:49 | |
| afazekas | https://wiki.openstack.org/wiki/StableBranch | 11:49 |
| afazekas | BTW: If you are lucky the backport is clickable on gerrit | 11:50 |
| *** Madan has quit IRC | 11:53 | |
| SridharG | sergsh: may i know the bug you are referring to in Neutron? | 11:54 |
| sergsh | afazekas, SridharG , the change was committed already to Kilo by Dane Leblanc: https://review.openstack.org/#/c/134978/ | 11:57 |
| sergsh | and my test for it fails in Juno jobs: https://review.openstack.org/#/c/136909/ | 11:58 |
| SridharG | sergsh: the bug is marked as tags:added: juno-backport-potential | 11:58 |
| sergsh | SridharG, what does it mean? It MIGHT be backported? | 11:59 |
| SridharG | sergsh: so we can cherry pick and propose the same fix stable/juno branch. | 11:59 |
| sergsh | SridharG, great, and who can do it? :) | 11:59 |
| SridharG | sergsh: normally the owner of the original patch does it, but AFAIK anyone can propose the cherry pick (if the owner is busy with other stuff). | 12:00 |
| sdague | kashyap: the requirements sync end up being kind of important to actually ensure a consistent environment. | 12:01 |
| *** adalbas has joined #openstack-qa | 12:01 | |
| * afazekas clicked on the cherry-pick button | 12:02 | |
| kashyap | sdague, I see, noted. | 12:02 |
| sergsh | SridharG, ok, thanks, I'll talk to Dane | 12:02 |
| *** vigneshvar has joined #openstack-qa | 12:02 | |
| *** yfried is now known as yfried|afk | 12:02 | |
| sergsh | afazekas, thanks :) | 12:03 |
| SridharG | sergsh: wlc. | 12:03 |
| *** markus_z has quit IRC | 12:03 | |
| sdague | kashyap: maybe if we start using a virtual env instead of installing services into system libs we can get rid of it | 12:04 |
| kashyap | sdague, Yeah. I bring it up because, sometimes, I have to manually do a 'git checkout *requirements.txt' then, a script that traverses all git repos to do a git pull | 12:06 |
| SridharG | afazekas: a tiny patch. Can you please review when you get some time. https://review.openstack.org/#/c/129993/1 | 12:07 |
| *** yfried|afk is now known as yfried | 12:08 | |
| kashyap | sdague, While I have your attention, RECLONE=yes in local.conf annoyingly removes branch tracking, any reason why? | 12:08 |
| kashyap | Which results in me having to manually set upstream tracking $ git branch --set-upstream master origin | 12:09 |
| sdague | kashyap: don't know about that one | 12:10 |
| kashyap | Anyhow, /me stopped using RECLONE=yes & do a git pull of project repos via a silly script | 12:10 |
| sdague | so that should be fixed | 12:10 |
| sdague | in theory there is also an UNDO_REQUIREMENTS which should be true by default, which does the first thing | 12:10 |
| sdague | but... a bunch of this is subtle | 12:10 |
| yfried | sergsh: btw, if you have a test to recreate a bug and test for it, it's good to have a "related-bug" in commit message, or even add tempest to the bug and add "closes-bug" the the commit | 12:10 |
| kashyap | Ah, didn't know of UNDO_REQ. . ., thank you, will test in one my runs to see how it goes. | 12:12 |
| sergsh | yfried, closing bug - but it's not tempest bug..? | 12:12 |
| sdague | kashyap: it should be set by default, but the whole dance around requirements is very subtle, if you look at the implementation | 12:12 |
| yfried | sergsh: ^ as I said, you can add tempest to the bug page | 12:13 |
| sergsh | yfried, ah, sorry, got it :) | 12:13 |
| yfried | sergsh: https://review.openstack.org/#/c/124722/ | 12:13 |
| yfried | sergsh: see the attached bug for example | 12:13 |
| kashyap | sdague, Yep, will have to take a look. On a different note, do you use 'devpi' in your test environments? I recently stumbled across it via danpb's blog post, seems like a very useful method. | 12:14 |
| sdague | kashyap: I do not, but I think it would be really valuable to integrate into devstack | 12:14 |
| openstackgerrit | Sergey Shnaidman proposed openstack/tempest: Test delete of SLAAC subnet without port delete https://review.openstack.org/136909 | 12:14 |
| openstackgerrit | Udi Kalifon proposed openstack/tempest: Support creating users with a default_project_id https://review.openstack.org/135922 | 12:15 |
| kashyap | sdague, Nice idea, probably someone experienced with it should bring this topic up on openstack-dev list. | 12:15 |
| *** jhenner has joined #openstack-qa | 12:16 | |
| *** tkammer has quit IRC | 12:16 | |
| *** markus_z has joined #openstack-qa | 12:16 | |
| *** tochi has quit IRC | 12:20 | |
| sdague | kashyap: honestly, I think people just need to do it | 12:21 |
| kashyap | sdague, Probably. I'm just not experienced enough with this stuff (requirements management) to speak definitively. | 12:23 |
| *** salv-orlando has quit IRC | 12:25 | |
| *** tkammer has joined #openstack-qa | 12:26 | |
| *** vigneshvar has quit IRC | 12:30 | |
| *** avico has quit IRC | 12:30 | |
| *** luqas has quit IRC | 12:31 | |
| openstackgerrit | Abhishek G M proposed openstack/tempest: Test to create bulk port https://review.openstack.org/137038 | 12:42 |
| *** weshay has joined #openstack-qa | 12:42 | |
| *** Longgeek_ has joined #openstack-qa | 12:44 | |
| *** yamamoto has joined #openstack-qa | 12:44 | |
| *** Longgeek has quit IRC | 12:44 | |
| openstackgerrit | Denis M. proposed openstack-dev/devstack: Copy datastore templates when installing Trove https://review.openstack.org/137039 | 12:44 |
| openstackgerrit | Kyle Mestery proposed openstack-dev/devstack: Update the ODL support to Helium SR1. https://review.openstack.org/134309 | 12:46 |
| *** yamamoto has quit IRC | 12:49 | |
| *** OmPrakashPandey has quit IRC | 12:49 | |
| *** mkollaro has joined #openstack-qa | 12:54 | |
| openstackgerrit | Kirill Shileev proposed openstack/tempest: Add scenario test related to the way IPv6 addressed assigned to vNIC https://review.openstack.org/112336 | 13:00 |
| *** gszasz_ has joined #openstack-qa | 13:06 | |
| *** gszasz has quit IRC | 13:07 | |
| *** yamamoto has joined #openstack-qa | 13:08 | |
| *** gszasz_ has quit IRC | 13:08 | |
| *** jordanP has quit IRC | 13:10 | |
| *** mpaolino has quit IRC | 13:12 | |
| *** yamamoto has quit IRC | 13:13 | |
| *** mdbooth has quit IRC | 13:15 | |
| *** neeti has quit IRC | 13:16 | |
| openstackgerrit | Sean Dague proposed openstack/tempest: remove xml_utils and all things that depend on it https://review.openstack.org/136822 | 13:17 |
| openstackgerrit | Yair Fried proposed openstack/tempest: Adds scenario for network-large-ops https://review.openstack.org/136789 | 13:17 |
| *** JayJ has joined #openstack-qa | 13:17 | |
| yfried | sergsh: pushed a fix ^ | 13:17 |
| yfried | sergsh: it ran on my setup | 13:17 |
| openstackgerrit | Chmouel Boudjnah proposed openstack/qa-specs: Add devstack external plugin spec https://review.openstack.org/137054 | 13:19 |
| openstackgerrit | Sean Dague proposed openstack/tempest: rm pyc files before test runs https://review.openstack.org/137055 | 13:19 |
| sergsh | yfried, can you also address my inline comments? theres is a typo in test name | 13:21 |
| *** chandankumar has quit IRC | 13:21 | |
| *** JayJ has quit IRC | 13:22 | |
| *** JayJ has joined #openstack-qa | 13:22 | |
| *** Longgeek has joined #openstack-qa | 13:24 | |
| yfried | sergsh: sure | 13:24 |
| yfried | sergsh: didn't see it | 13:24 |
| *** gszasz has joined #openstack-qa | 13:25 | |
| *** markus_z has quit IRC | 13:25 | |
| *** JayJ has quit IRC | 13:27 | |
| *** Longgeek_ has quit IRC | 13:27 | |
| *** JayJ has joined #openstack-qa | 13:27 | |
| openstackgerrit | Kirill Shileev proposed openstack/tempest: Adds scenario for IPv6 addresses https://review.openstack.org/112336 | 13:28 |
| sergsh | yfried, http://pastebin.com/izyUA7kM | 13:29 |
| openstackgerrit | Denis M. proposed openstack-dev/devstack: Copy datastore templates when installing Trove https://review.openstack.org/137039 | 13:29 |
| *** JayJ has quit IRC | 13:32 | |
| *** JayJ has joined #openstack-qa | 13:32 | |
| openstackgerrit | Eric Harney proposed openstack-dev/devstack: Ceph: undefine secret from nova.conf when deleting secret https://review.openstack.org/125432 | 13:33 |
| openstackgerrit | Denis M. proposed openstack-dev/devstack: Increate time on start for instance datastore https://review.openstack.org/137062 | 13:37 |
| *** topshare has joined #openstack-qa | 13:38 | |
| *** markus_z has joined #openstack-qa | 13:38 | |
| nfedotov | Hello all! Does somebody know... Is Devstack going to start using Cirros 0.3.3 image by default? Sorry for off-topic | 13:39 |
| *** mpaolino has joined #openstack-qa | 13:41 | |
| *** nosnos has quit IRC | 13:48 | |
| *** enikanorov__ has quit IRC | 13:48 | |
| *** nosnos has joined #openstack-qa | 13:49 | |
| openstackrecheck | openstack/ceilometer change: https://review.openstack.org/136781 failed gate-ceilometer-pep8 in the gate queue with an unrecognized error | 13:52 |
| *** salv-orlando has joined #openstack-qa | 13:53 | |
| *** nosnos has quit IRC | 13:54 | |
| openstackgerrit | Kirill Shileev proposed openstack/tempest: Adds scenario for IPv6 addresses https://review.openstack.org/112336 | 13:56 |
| *** markus_z has quit IRC | 13:57 | |
| *** enikanorov_ has joined #openstack-qa | 13:57 | |
| *** dims has quit IRC | 13:57 | |
| *** yamahata has joined #openstack-qa | 13:58 | |
| *** dims has joined #openstack-qa | 13:58 | |
| openstackgerrit | Sean Dague proposed openstack/tempest: Enable block_migration_for_live_migration by default https://review.openstack.org/135142 | 13:59 |
| openstackgerrit | Yair Fried proposed openstack/tempest: Adds scenario for network-large-ops https://review.openstack.org/136789 | 14:00 |
| yfried | sergsh: take a look ^ | 14:01 |
| sdague | nfedotov: if there is a new cirros, patches welcomed to bump it up | 14:02 |
| *** dustins has joined #openstack-qa | 14:06 | |
| *** beagles is now known as beagles_brb | 14:10 | |
| *** markus_z has joined #openstack-qa | 14:10 | |
| *** toure has joined #openstack-qa | 14:12 | |
| *** yamamoto has joined #openstack-qa | 14:14 | |
| *** dkranz has joined #openstack-qa | 14:14 | |
| *** dustins has quit IRC | 14:18 | |
| *** yamamoto has quit IRC | 14:18 | |
| *** dustins has joined #openstack-qa | 14:20 | |
| *** dustins has quit IRC | 14:20 | |
| nfedotov | sdague: The reason I ask is because the patchset already exists. https://review.openstack.org/#/c/122936/ . Anyway, thanks. Maybe it would be better to create new patchset for it | 14:21 |
| sdague | nfedotov: ok, but it's not passing tests | 14:21 |
| sdague | did you look into why? | 14:21 |
| sdague | ianw's -1 is because it's not passing tests | 14:21 |
| *** rushiagr is now known as rushiagr_away | 14:24 | |
| *** mriedem has joined #openstack-qa | 14:26 | |
| yfried | jogo: around? | 14:27 |
| *** jlibosva has joined #openstack-qa | 14:28 | |
| sdague | yfried: this is very early for jogo | 14:28 |
| *** jenrh has joined #openstack-qa | 14:32 | |
| mriedem | any ideas if we have a query for this issue already? http://goo.gl/DdBdqx | 14:34 |
| mriedem | cinder and nova logs don't have any errors, | 14:35 |
| mriedem | but must be something blocking a volume operation somewhere in there | 14:35 |
| openstackgerrit | Michele Paolino proposed openstack-dev/devstack: Support for libvirt/QEMU tar releases https://review.openstack.org/108714 | 14:36 |
| sdague | mriedem: so... honestly, I expect this is vaguely related to the ML post I put out there | 14:37 |
| sdague | we're increasing the # of volume tests | 14:37 |
| sdague | hitting critical sections in cinder | 14:37 |
| sdague | and ... sadness | 14:37 |
| mriedem | we've had known lvm issues in the gate for awhile causing locking issues, re: the kernel thing | 14:38 |
| mriedem | so i can buy that | 14:38 |
| mriedem | would be nice to see something in the logs | 14:38 |
| sdague | yeh... agreed | 14:38 |
| *** nmagnezi has quit IRC | 14:40 | |
| mriedem | i see a 3 minute gap here in the volume delete flow | 14:40 |
| mriedem | start: http://logs.openstack.org/90/131490/4/gate/gate-grenade-dsvm-partial-ncpu/0537e3b/logs/old/screen-c-vol.txt.gz#_2014-11-25_03_41_22_466 | 14:40 |
| mriedem | next mention: http://logs.openstack.org/90/131490/4/gate/gate-grenade-dsvm-partial-ncpu/0537e3b/logs/old/screen-c-vol.txt.gz#_2014-11-25_03_44_41_032 | 14:40 |
| mriedem | tempest failed at 3:44: http://logs.openstack.org/90/131490/4/gate/gate-grenade-dsvm-partial-ncpu/0537e3b/logs/grenade.sh.txt.gz#_2014-11-25_03_44_48_217 | 14:41 |
| mriedem | sdague: would you be opposed to having an e-r query with this? | 14:41 |
| mriedem | message:"(TestVolumeBootPattern:_run_cleanups) Failed to delete volume" AND message:"within the required time" AND tags:"console" | 14:42 |
| sdague | mriedem: nope, sounds good to me | 14:42 |
| mriedem | it's pretty generic i know | 14:42 |
| mriedem | ok | 14:42 |
| *** om has joined #openstack-qa | 14:42 | |
| sdague | realistically I'm pretty sure that this is because cinder deletes are taking *for ever* | 14:42 |
| sdague | which... I'm not sure why | 14:42 |
| mriedem | well, i've seen some of the commands take between a couple seconds and 2 minutes, | 14:42 |
| mriedem | in the periodic task that checks volume status | 14:42 |
| sdague | right... that's that lvm query that stalls | 14:43 |
| mriedem | i think the delete flow is hitting an i/o block or process lock or something when a periodic task is running | 14:43 |
| sdague | maybe, that's the thing | 14:43 |
| sdague | yeh, what's actually crazy is that it's the blockdev query | 14:43 |
| sdague | it's not actually an action | 14:43 |
| mriedem | this is the bug i think we were tracking https://bugs.launchpad.net/cinder/+bug/1373513 | 14:43 |
| sdague | yeh, so basically we need to figure out which cinder cores can help dive in, or we just start turning off tests | 14:44 |
| mriedem | test_volume_boot_pattern would be my first candidate :) | 14:47 |
| mriedem | between the volume delete hangs and the ssh bullshit, i hate that test | 14:48 |
| mriedem | i'm pretty sure test_volume_boot_pattern sabotaged my mic | 14:48 |
| *** yfried is now known as yfried|afk | 14:48 | |
| sdague | heh | 14:48 |
| sdague | mriedem: push the skip | 14:48 |
| sdague | I'll +2 it | 14:48 |
| *** markus_z has quit IRC | 14:49 | |
| sdague | that test we've turned off a ton in the past | 14:49 |
| mriedem | k, getting the e-r query up first | 14:49 |
| openstackgerrit | Merged openstack/tempest: Use standard assertVolumeStatusWait for volume detachment https://review.openstack.org/130262 | 14:51 |
| *** rushiagr_away is now known as rushiagr | 14:51 | |
| *** markus_z has joined #openstack-qa | 14:51 | |
| *** yfried|afk is now known as yfried | 14:51 | |
| mtreinish | jogo: awesome | 14:53 |
| *** tosky has quit IRC | 14:56 | |
| *** markus_z has quit IRC | 14:57 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for cinder volume delete hang bug 1396186 https://review.openstack.org/137090 | 14:57 |
| *** tosky has joined #openstack-qa | 14:57 | |
| mriedem | sdague: mtreinish: ^ | 14:58 |
| mtreinish | mriedem: +A | 14:59 |
| *** beagles_brb is now known as beagles | 15:00 | |
| openstackgerrit | Merged openstack/tempest: Sync latest log module from oslo-incubator https://review.openstack.org/131601 | 15:00 |
| *** markmcclain has joined #openstack-qa | 15:01 | |
| openstackgerrit | Merged openstack/tempest: enable cinder v2 api for test_volumes_backup https://review.openstack.org/135179 | 15:01 |
| *** markus_z has joined #openstack-qa | 15:01 | |
| *** topshare has quit IRC | 15:02 | |
| *** zz_jgrimm is now known as jgrimm | 15:03 | |
| mriedem | sdague: replied to ML, working on that skip patch now | 15:03 |
| *** raja has joined #openstack-qa | 15:03 | |
| sdague | mriedem: danke | 15:03 |
| *** raja is now known as Guest83728 | 15:04 | |
| mriedem | this took 50 seconds | 15:04 |
| mriedem | 2014-11-25 03:41:48.993 7804 DEBUG cinder.openstack.common.processutils [-] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 execute /opt/stack/old/cinder/cinder/openstack/common/processutils.py:158 | 15:04 |
| sdague | mtreinish: so I -2ed a jogo patch to change a tempest default that hit the gate this morning, I'm pretty convinced that was not the right way to change the live migration configs | 15:04 |
| sergsh | yfried, http://paste.ubuntu.com/9233767/ | 15:04 |
| sdague | mtreinish: https://review.openstack.org/#/c/135142/ | 15:04 |
| openstackgerrit | Jiri Tomasek proposed openstack/tempest: Dashboard login page assert string fix https://review.openstack.org/137092 | 15:05 |
| *** rbak has joined #openstack-qa | 15:05 | |
| mriedem | this took almost 2 minutes: | 15:05 |
| mriedem | 2014-11-25 03:42:44.858 7804 DEBUG cinder.openstack.common.processutils [req-81b41283-0928-4572-891e-c45ef4667e64 4eb70d740cda49618ccb9ac9b64ca824 5a2e289cbd224a84a78f496717d98684 - - -] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix stack-volumes-lvmdriver-1 execute /opt/stack/old/cinder/cinder/openstack/common/processutils.py:158 | 15:05 |
| sdague | mriedem: yeh, then it failed with a timeout, right? | 15:06 |
| mriedem | sdague: yup | 15:07 |
| Guest83728 | I have a devstack running. i want to work on "hot swap volume" feature | 15:07 |
| mriedem | so that's 2 commands taking ~3 minutes total which is the gap and then the timeout | 15:07 |
| Guest83728 | can anyone help me on this pls | 15:07 |
| mriedem | vgs and lvs, which is what i've seen before | 15:07 |
| mtreinish | sdague: hmm, that might be, let me check what the option does | 15:07 |
| *** yamahata has quit IRC | 15:08 | |
| mtreinish | I was fine with changing the other live_migration flag to default true because that's really the hypervisor opt (we still check host count) | 15:08 |
| sdague | mtreinish: how is hostcount checked? | 15:08 |
| *** avico has joined #openstack-qa | 15:09 | |
| *** Guest83728 has left #openstack-qa | 15:10 | |
| mtreinish | sdague: http://git.openstack.org/cgit/openstack/tempest/tree/tempest/api/compute/test_live_block_migration.py#n91 | 15:10 |
| mtreinish | it does a list-hosts and checks how many compute nodes are there | 15:10 |
| sdague | ok | 15:10 |
| sdague | so ... test_live_migration should live in an admin tree then | 15:10 |
| mtreinish | it should | 15:11 |
| sdague | which it probably should have anyway | 15:11 |
| *** rajashekar_vedam has joined #openstack-qa | 15:11 | |
| mtreinish | I really don't know why it was where it was in the tree | 15:11 |
| *** afazekas has quit IRC | 15:11 | |
| rajashekar_vedam | Is there any "hot swap volume" feature in cinder? | 15:11 |
| sdague | ok, well it can't pass until the precise jobs get fixed | 15:11 |
| openstackgerrit | Sean Dague proposed openstack/tempest: Enable block_migration_for_live_migration by default https://review.openstack.org/135142 | 15:13 |
| *** mwagner_lap has quit IRC | 15:13 | |
| mtreinish | sdague: but for the block migration flag I'm not exactly sure what the default should be, it's a bit different | 15:13 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for cinder volume delete hang bug 1396186 https://review.openstack.org/137090 | 15:13 |
| sdague | ok, well put your comments on it | 15:13 |
| yfried | sergsh: how many VMs are you building? | 15:13 |
| sergsh | yfried,10 | 15:14 |
| yfried | sergsh: does your setup support this large amount? | 15:14 |
| yfried | sergsh: what version are you using? | 15:14 |
| sergsh | yfried, should support, I'll try with 2, let's see | 15:15 |
| yfried | sergsh: is this devstack? all in one? | 15:16 |
| rajashekar_vedam | Is there any "hot swap volume" feature in cinder? | 15:16 |
| *** yamahata has joined #openstack-qa | 15:16 | |
| *** bkopilov has quit IRC | 15:16 | |
| *** zz_dimtruck is now known as dimtruck | 15:16 | |
| sergsh | yfried, yes | 15:16 |
| sergsh | yfried, version of what? | 15:17 |
| yfried | sergsh: openstack | 15:17 |
| openstackgerrit | Matt Riedemann proposed openstack/tempest: Skip test_volume_boot_pattern until bug 1396186 is fixed https://review.openstack.org/137096 | 15:18 |
| mriedem | sdague: there you go ^ | 15:18 |
| sergsh | yfried, a few days ago version, wait a moment, I'll install the latest | 15:18 |
| *** jordanP has joined #openstack-qa | 15:19 | |
| *** openstackrecheck has quit IRC | 15:21 | |
| *** openstackrecheck has joined #openstack-qa | 15:21 | |
| mtreinish | mriedem: are you going to push up a revert for the e-r query we just landed if it's covered by another one? | 15:23 |
| mriedem | mtreinish: yeah | 15:23 |
| mriedem | oops | 15:23 |
| openstackgerrit | Matt Riedemann proposed openstack/tempest: Skip test_volume_boot_pattern until bug 1373513 is fixed https://review.openstack.org/137096 | 15:23 |
| mtreinish | heh, we've got enough queries it's hard to know what's in all of them | 15:23 |
| mriedem | i had looked at the other but only noticed the first part before the OR | 15:24 |
| mtreinish | I'm wondering if we should have a test that looks for the same set of matches between queries | 15:24 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Revert "Add query for cinder volume delete hang bug 1396186" https://review.openstack.org/137098 | 15:25 |
| mriedem | mtreinish: there is the revert | 15:25 |
| *** jordanP has quit IRC | 15:25 | |
| *** jordanP has joined #openstack-qa | 15:26 | |
| mtreinish | mriedem: ok, +A | 15:26 |
| *** jordanP has quit IRC | 15:26 | |
| mriedem | mtreinish: this didn't have enough related bugs for you? :) https://review.openstack.org/#/c/137096/ | 15:26 |
| *** jordanP has joined #openstack-qa | 15:27 | |
| yfried | sergsh: don't bother. I'm testing on juno | 15:28 |
| *** achanda has joined #openstack-qa | 15:29 | |
| sdague | mtreinish: see ML for a series of test definition related emails this morning. Mostly trying to trim back things that don't provide value. | 15:29 |
| sergsh | yfried, but should it work on kilo also? | 15:29 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add cli option to subunit2sql to specify run_id https://review.openstack.org/131298 | 15:29 |
| yfried | sergsh: no reason why not. | 15:30 |
| *** gszasz has quit IRC | 15:30 | |
| yfried | sergsh: are you using a VM? | 15:30 |
| sergsh | no, hadware | 15:30 |
| yfried | sergsh: have you disabled the limits? | 15:30 |
| yfried | sergsh: quotas? | 15:30 |
| sergsh | I think it has default 10 instances, no? | 15:30 |
| *** bkopilov has joined #openstack-qa | 15:31 | |
| *** achanda has quit IRC | 15:32 | |
| openstackgerrit | Kirill Shileev proposed openstack/tempest: Adds scenario for IPv6 addresses https://review.openstack.org/112336 | 15:33 |
| yfried | sergsh: there are quotas in neutron that would be exceeded if you are creating 10 machines | 15:36 |
| *** rajashekar_vedam has quit IRC | 15:36 | |
| yfried | sergsh: see my commit message | 15:36 |
| openstackgerrit | Merged openstack/tempest: Security Groups API Tests Enhancements https://review.openstack.org/107654 | 15:38 |
| openstackgerrit | Merged openstack/tempest: Updated from global requirements https://review.openstack.org/135994 | 15:38 |
| *** om has quit IRC | 15:38 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Revert "Add query for cinder volume delete hang bug 1396186" https://review.openstack.org/137098 | 15:40 |
| openstackgerrit | Chmouel Boudjnah proposed openstack/qa-specs: Add devstack external plugin spec https://review.openstack.org/137054 | 15:41 |
| yfried | dkranz: ping | 15:43 |
| dkranz | yfried: busy now, what's up? | 15:43 |
| yfried | dkranz: just wanted to ping you about the client-return-value bp. I said I'd help you with it and I saw it just got merged | 15:44 |
| dkranz | yfried: This needs to merge: https://review.openstack.org/#/c/130645/ | 15:46 |
| dkranz | yfried: Then the spec has an etherpad to track work on each service. | 15:46 |
| dkranz | yfried: You just pick one, and change all client and test uses | 15:47 |
| yfried | dkranz: ok. will start tomorrow | 15:48 |
| *** achanda has joined #openstack-qa | 15:48 | |
| yfried | mtreinish: dkranz: btw, who's in charge of the tempset cleanup util? | 15:49 |
| dkranz | yfried: dpatterson | 15:49 |
| dkranz | yfried: He said there is a patch up for review that fixes the issue you saw | 15:50 |
| *** openstackrecheck has quit IRC | 15:50 | |
| *** openstackrecheck has joined #openstack-qa | 15:50 | |
| yfried | dkranz: what TZ is he? | 15:51 |
| dkranz | yfried: us east | 15:51 |
| *** avico has quit IRC | 15:51 | |
| dkranz | yfried: same as me | 15:51 |
| yfried | dkranz: I just discovered stackforge/ospurge which cleans up all resources in a tenant. seems like a duplication of effort. what's the policy on using it in tempest? | 15:52 |
| *** avico has joined #openstack-qa | 15:53 | |
| mestery | Hi QA folks! If I could get some time for this super simple review https://review.openstack.org/#/c/134309/. It enables an updated version of ODL in devstack, which fixes IPV6 there and lets the Tempest API tests run again. We need this to land to re-enable our CI. | 15:54 |
| mestery | Thanks for the help! | 15:54 |
| openstackgerrit | Sean Dague proposed openstack/tempest: delete all compute xml tests https://review.openstack.org/136792 | 15:56 |
| openstackgerrit | Sean Dague proposed openstack/tempest: part 2 of delete xml https://review.openstack.org/136815 | 15:56 |
| openstackgerrit | Sean Dague proposed openstack/tempest: purge xml clients from tempest.clients https://review.openstack.org/136821 | 15:56 |
| openstackgerrit | Sean Dague proposed openstack/tempest: remove xml_utils and all things that depend on it https://review.openstack.org/136822 | 15:56 |
| openstackgerrit | Sean Dague proposed openstack/tempest: use built in xml.etree instead of lxml https://review.openstack.org/137113 | 15:56 |
| openstackgerrit | Aysy Anne A. Duarte proposed openstack-infra/elastic-recheck: Add query for insufficient free space bug 1386249 https://review.openstack.org/132118 | 15:56 |
| sdague | mtreinish: https://review.openstack.org/#/c/137055/ | 15:57 |
| sdague | mestery: so.... I'll +2 that *if* someone from ODL is going to convert this to a devstack plugin once we get that speced out | 15:58 |
| sdague | because I actually don't think opendaylight should be a top level construct in devstack | 15:58 |
| mestery | sdague: Absolutely! At one point we wanted it a top-level construct, but I agree, making it a plugin gets a huge +1 from me. | 15:58 |
| mestery | sdague: Is there a spec for devstack plugins proposed yet? | 15:59 |
| mtreinish | mestery: https://review.openstack.org/137054 | 15:59 |
| mestery | mtreinish: Thanks! | 15:59 |
| mestery | mtreinish sdague: That's a fresh spec :) | 16:00 |
| *** SridharG has left #openstack-qa | 16:01 | |
| sdague | mestery: it is | 16:01 |
| sdague | which is why I'll still give you a +2 | 16:01 |
| mtreinish | mestery: heh, that's how I know about it, I just saw it pop up somewhere | 16:01 |
| mestery | lol | 16:01 |
| sdague | yeh it started with a chmouel email from earlier this week | 16:01 |
| *** achanda has quit IRC | 16:02 | |
| mestery | sdague: Thanks, we'll work to make sure ODL fits into this once it's ready, I've added it to my review list. | 16:02 |
| sdague | mtreinish: https://review.openstack.org/#/c/137055/ | 16:02 |
| sdague | mostly because one of the rmxml patches died because we didn't have that | 16:03 |
| *** nfedotov has quit IRC | 16:07 | |
| *** jlibosva has quit IRC | 16:08 | |
| dkranz | yfried: Yes there is duplication and that was discussed. But sometimes it costs more to reduce duplication than to have it. | 16:12 |
| *** chandankumar has joined #openstack-qa | 16:12 | |
| dkranz | yfried: I believe this code belongs in tempest. If some one wants to take the other code, make it work in tempest, and remove the current cleanup I have no issus with that. | 16:13 |
| dkranz | yfried: Assuming it was better than what we have now. | 16:13 |
| *** yfried has quit IRC | 16:14 | |
| *** yamamoto has joined #openstack-qa | 16:16 | |
| *** bkopilov has quit IRC | 16:17 | |
| *** matrohon has quit IRC | 16:20 | |
| *** yamamoto has quit IRC | 16:21 | |
| *** avico has quit IRC | 16:23 | |
| *** X019 has quit IRC | 16:23 | |
| *** X019 has joined #openstack-qa | 16:24 | |
| *** JayJ has quit IRC | 16:29 | |
| *** om has joined #openstack-qa | 16:29 | |
| *** jenrh has quit IRC | 16:29 | |
| *** obondarev has quit IRC | 16:32 | |
| *** tkammer has quit IRC | 16:35 | |
| openstackgerrit | chandan kumar proposed openstack/tempest: Enable cinder v2 api tests in volume quotas https://review.openstack.org/134889 | 16:36 |
| *** X019 has quit IRC | 16:37 | |
| *** sergsh has quit IRC | 16:40 | |
| openstackgerrit | Rob Crittenden proposed openstack/tempest: Add ca_certificates_file option to test against SSL servers https://review.openstack.org/136793 | 16:41 |
| *** shashankhegde has joined #openstack-qa | 16:42 | |
| *** X019 has joined #openstack-qa | 16:43 | |
| jgriffith | sdague: looks like about 6 common cinder failures | 16:46 |
| sdague | jgriffith: yeh | 16:46 |
| jgriffith | sdague: 3 inparticular with a super high freq | 16:46 |
| *** mpaolino has quit IRC | 16:47 | |
| sdague | which is why I'm concerned on piling on new tests when those aren't understood | 16:47 |
| jgriffith | sdague: see what thingee has to say but I'll put it on my plate to see if I can't start whitling some of them | 16:47 |
| sdague | that would be awesome | 16:47 |
| jgriffith | sdague: encryption is def broken based on the initial data | 16:47 |
| jgriffith | sdague: but it looks like it's just because it's horribly slow | 16:47 |
| jgriffith | anyway | 16:47 |
| jgriffith | sdague: I'll sign up to see if I can help | 16:48 |
| sdague | so I think there is also a root cause that lvs scans can go into an extremely long (2 minute) timeout if something happens underneath | 16:48 |
| jgriffith | sdague: yeah, that whole thing is still killing me | 16:48 |
| sdague | I kind of wonder if we can do an equivalent thing on a shorter timeout | 16:48 |
| sdague | because when it succeeds, it's a couple of seconds | 16:48 |
| jgriffith | sdague: it seems like there's something going on in parallel that's causing that | 16:48 |
| sdague | at most | 16:48 |
| jgriffith | if that makes sense? | 16:48 |
| sdague | yep, very well could be | 16:49 |
| jgriffith | sdague: in other words, I have a rig running just volume tests and not triggering it | 16:49 |
| jgriffith | sdague: but once I get my lab back I want to do some better data colection on that | 16:49 |
| jgriffith | currently I have no gear, they "lost" my servers in the move last week :( | 16:49 |
| sdague | jgriffith: yeh, I wonder what else needs to be in the mix | 16:49 |
| sdague | bummer | 16:49 |
| jgriffith | sdague: I'm going to try and light bulb that, but it's going to surely take a while | 16:50 |
| jgriffith | sdague: like mid next week best case | 16:50 |
| sdague | yeh, no worries | 16:50 |
| jgriffith | k | 16:50 |
| sdague | mostly I wanted to get the conversations rolling here to make sure they hadn't gotten lost | 16:50 |
| jgriffith | I'll keep you posted, or if you come across something new ping me please | 16:50 |
| jgriffith | communication will go a long way on this I thing | 16:50 |
| *** sergsh has joined #openstack-qa | 16:50 | |
| jgriffith | no, certainly not lost | 16:50 |
| jgriffith | just horrible timing :) | 16:50 |
| sdague | :) | 16:51 |
| *** sergsh is now known as sergsh_away | 16:51 | |
| *** chandankumar has quit IRC | 16:51 | |
| jgriffith | of course it's never a good time :) | 16:53 |
| *** e0ne has quit IRC | 16:54 | |
| *** nmagnezi has joined #openstack-qa | 16:58 | |
| *** Longgeek has quit IRC | 16:58 | |
| *** amotoki has quit IRC | 17:00 | |
| *** markus_z has quit IRC | 17:01 | |
| *** yfried has joined #openstack-qa | 17:01 | |
| *** salv-orlando has quit IRC | 17:01 | |
| yfried | mtreinish: dkranz: sdague: could you please take a look? https://review.openstack.org/#/c/136611/ | 17:02 |
| yfried | mkoderer: ^ | 17:02 |
| *** om has quit IRC | 17:02 | |
| *** kmartin has quit IRC | 17:05 | |
| *** dims has quit IRC | 17:09 | |
| *** avico has joined #openstack-qa | 17:10 | |
| *** markmcclain has quit IRC | 17:11 | |
| *** yamahata has quit IRC | 17:14 | |
| *** StevenK has quit IRC | 17:18 | |
| *** StevenK has joined #openstack-qa | 17:20 | |
| mtreinish | jogo: when you're around: http://paste.openstack.org/show/138278/ top 25 failure counts for a ~week | 17:21 |
| *** shashankhegde has quit IRC | 17:21 | |
| mtreinish | although the queue filtering isn't perfect yet so a few check jobs still slip in | 17:21 |
| sdague | mtreinish: you should do it by percentage | 17:24 |
| sdague | absolutes aren't quite as useful as percentages | 17:24 |
| mtreinish | sdague: well it's just a db query, I was going to do a percentage on the db api side | 17:25 |
| clarkb | one interesting thing about those numbers i sthe tests we run more fail less | 17:25 |
| sdague | clarkb: well... it's a slice | 17:26 |
| sdague | mtreinish: can I get access to the sql connection from here (i.e. is the proxy up?) | 17:26 |
| openstackgerrit | Sean Dague proposed openstack/tempest: use built in HTMLParser instead of lxml https://review.openstack.org/137113 | 17:26 |
| mtreinish | sdague: nope not yet, the review is still pending: https://review.openstack.org/122311 and there are some new hiera values for it too | 17:27 |
| sdague | clarkb: honestly, at limit 25 out of 2200 tests, I wouldn't read too much into it | 17:27 |
| openstackgerrit | Merged openstack/tempest: Unified interface for ScenarioTest and NetworkScenarioTest https://review.openstack.org/136791 | 17:27 |
| clarkb | sdague: but its sorted by fail right? | 17:28 |
| sdague | clarkb: by absolute fail # | 17:28 |
| sdague | which doesn't take into account percentages | 17:28 |
| mtreinish | sdague, clarkb: at least for the top 2 those are for a stable bug that popped up yesterday (or over the weekend) for a test added recently (I think) | 17:28 |
| mtreinish | which would explain the smaller numbers | 17:28 |
| *** jordanP has quit IRC | 17:29 | |
| adam_g | mtreinish, which bug is that? | 17:30 |
| mtreinish | the one which stands out most to me is the heat cfn init failure number which was like 25% before we skipped it | 17:30 |
| jogo | mtreinish: nice | 17:30 |
| mtreinish | adam_g: https://bugs.launchpad.net/tempest/+bug/1395368 (or least that's the bug I saw for it) | 17:31 |
| sdague | yeh, which, realistically is just that fedora guests 2nd level are untenable | 17:32 |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/136438 failed because of: gate-cinder-docs: https://bugs.launchpad.net/bugs/1298006 | 17:33 |
| *** jlanoux has quit IRC | 17:33 | |
| *** dustins has joined #openstack-qa | 17:33 | |
| *** dustins has quit IRC | 17:34 | |
| *** beagles is now known as beagles_brb | 17:34 | |
| *** qba73 has quit IRC | 17:38 | |
| *** dustins has joined #openstack-qa | 17:38 | |
| *** e0ne has joined #openstack-qa | 17:40 | |
| jogo | adam_g: ping | 17:41 |
| jogo | mtreinish: will that data be published in an automatic report somewhere? | 17:41 |
| *** shashankhegde has joined #openstack-qa | 17:41 | |
| *** andreykurilin_ has joined #openstack-qa | 17:42 | |
| jogo | adam_g: latest live migration test run | 17:42 |
| *** dustins has quit IRC | 17:42 | |
| mtreinish | jogo: maybe, but it's not ready for that though | 17:42 |
| mtreinish | we still need to get public read-only access to the db | 17:42 |
| *** melwitt has joined #openstack-qa | 17:42 | |
| *** dustins has joined #openstack-qa | 17:42 | |
| mtreinish | right now it's just on the trove node on rax which is on the "private" network | 17:42 |
| jogo | mtreinish: ahh | 17:43 |
| mtreinish | the queries work by relay through fungi :) | 17:43 |
| jogo | ^_^ | 17:43 |
| *** wuhg has quit IRC | 17:43 | |
| *** luqas has joined #openstack-qa | 17:43 | |
| adam_g | jogo, hey | 17:44 |
| *** X019 has quit IRC | 17:45 | |
| *** avico has quit IRC | 17:45 | |
| *** luqas has quit IRC | 17:45 | |
| jogo | adam_g: still seeing the same failures | 17:46 |
| jogo | but now have auth log | 17:46 |
| *** shashankhegde has quit IRC | 17:46 | |
| adam_g | jogo, oh, anything useful? | 17:46 |
| fungi | mtreinish: i am not an api | 17:46 |
| fungi | ;) | 17:46 |
| fungi | (i am a meat popsicle) | 17:47 |
| jogo | adam_g: sshd[6170]: Connection closed by 10.208.34.141 [preauth] | 17:48 |
| jogo | adam_g: is all I could find | 17:48 |
| jogo | adam_g: and the second node is still having name resolution issues | 17:49 |
| *** harlowja_away is now known as harlowja | 17:49 | |
| adam_g | jogo, that looks more like a hostkey issue but those errors are logged with key error messages | 17:49 |
| *** marrusl has quit IRC | 17:49 | |
| adam_g | jogo, i have a pair of rax servers i prepped with the same networking that i can bring up and restack soon if you want to poke at more directly (in case you dont have something similar going) | 17:50 |
| jogo | adam_g: I don't | 17:50 |
| jogo | that would be usefu | 17:50 |
| jogo | useful | 17:50 |
| jogo | I wonder if this an ssh-agent issue | 17:50 |
| adam_g | there shouldn't be any ssh agent running there? | 17:51 |
| *** dimsum__ has joined #openstack-qa | 17:51 | |
| jogo | adam_g: I don't know | 17:52 |
| *** marrusl has joined #openstack-qa | 17:52 | |
| jogo | how else does it find the ssh keys to use | 17:52 |
| *** mkollaro has quit IRC | 17:53 | |
| *** mwagner_lap has joined #openstack-qa | 17:53 | |
| adam_g | jogo, i would have assumed python-libvirt/libvirt uses the users default path to key ($HOME/.ssh/id_$foo) but actually--ssh agent *might* explain why i was seeing it succeed in one direction and not the other last week | 17:55 |
| adam_g | but i dont usually forward my agent, hmm | 17:55 |
| jogo | adam_g: is your two node env set up | 17:56 |
| adam_g | jogo, rebuilding it now | 17:56 |
| *** directxman12 has joined #openstack-qa | 17:57 | |
| jogo | directxman12: o/ thanks | 17:57 |
| *** X019 has joined #openstack-qa | 17:57 | |
| jogo | http://logs.openstack.org/04/136504/3/experimental/check-tempest-dsvm-aiopcpu/f7eea47/logs/screen-n-cpu.txt.gz?level=TRACE#_2014-11-25_06_42_44_060 | 17:57 |
| jogo | DinaBelova: testing libvirt live block migration with qemu+ssh and no shared storage | 17:58 |
| jogo | directxman12: woops ^ | 17:58 |
| jogo | and ssh should be working between the two nodes | 17:58 |
| jogo | as its used earlier in the testing | 17:59 |
| directxman12 | jogo: if you su into the libvirt user, are you able to connect using `virsh -c 'qemu+ssh://xyz'` | 17:59 |
| jogo | directxman12: these are throw away gate nodes don't have one lying around | 17:59 |
| *** rushiagr is now known as rushiagr_away | 17:59 | |
| jogo | we are trying 'qemu+ssh://stack@xyz' since the stack user has ssh keys set up | 18:00 |
| jogo | adam_g: is bringing up a test env to reproduce this | 18:00 |
| directxman12 | jogo: ok | 18:01 |
| jogo | directxman12: how does libvirt find the ssh keys? | 18:02 |
| yfried | jogo: please take a look https://review.openstack.org/#/c/136981/ | 18:02 |
| yfried | jogo: it's the bug we've discussed last week | 18:02 |
| *** safchain has quit IRC | 18:03 | |
| directxman12 | jogo: but IIRC, live migration involves libvirt daemons connecting to each other, so I think it is going to be connecting as whatever user the libvirt daemon is running as | 18:03 |
| jogo | yfried: thanks! its on the list | 18:03 |
| yfried | jogo: what list? | 18:03 |
| jogo | yfried: list of reviews that I need to do | 18:03 |
| yfried | jogo: oh. YOUR list :) | 18:04 |
| adam_g | directxman12, you can specify user in qemu+ssh://$user@host and, as long as user is member of libvirtd group all should be okay | 18:04 |
| yfried | jogo: I have some more for you re that test :) | 18:04 |
| adam_g | at least, IIRC :) | 18:04 |
| directxman12 | adam_g: yeah, I know that | 18:04 |
| *** e0ne has quit IRC | 18:05 | |
| *** suneelb has joined #openstack-qa | 18:06 | |
| *** mriedem has quit IRC | 18:06 | |
| *** e0ne has joined #openstack-qa | 18:06 | |
| directxman12 | adam_g, jogo: hold on, I'm checking something | 18:07 |
| *** kmartin has joined #openstack-qa | 18:08 | |
| *** bkopilov has joined #openstack-qa | 18:09 | |
| *** btran has quit IRC | 18:09 | |
| *** jamielennox|away is now known as jamielennox | 18:11 | |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/131987 failed gate-grenade-dsvm in the gate queue with an unrecognized error | 18:12 |
| *** shashankhegde has joined #openstack-qa | 18:13 | |
| *** e0ne has quit IRC | 18:14 | |
| *** dbel has quit IRC | 18:16 | |
| *** e0ne has joined #openstack-qa | 18:16 | |
| directxman12 | jogo, adam_g: what migration flags are you using | 18:16 |
| adam_g | jogo, ^ | 18:17 |
| *** jpich has quit IRC | 18:18 | |
| directxman12 | jogo: also, just to confirm: the libvirt user on the source node can SSH into the stack user on the target node? | 18:20 |
| directxman12 | jogo: (or whatever user libvirtd is running as)? | 18:20 |
| jogo | directxman12: default | 18:21 |
| jogo | directxman12: default nova settings | 18:21 |
| *** beagles_brb is now known as beagles | 18:22 | |
| jogo | directxman12: maybe adam_g can confirm the ssh parat | 18:22 |
| clarkb | no libvirt user won't ssh as stack | 18:22 |
| clarkb | its stack to stack | 18:22 |
| *** mkollaro has joined #openstack-qa | 18:22 | |
| clarkb | so that is probably your issue | 18:22 |
| directxman12 | jogo: ok, so that means tunnelled p2p migration -- https://libvirt.org/migration.html#scenariotunnelpeer2peer2 | 18:22 |
| clarkb | (at least if my reading of the code last week is still valid) | 18:22 |
| *** e0ne has quit IRC | 18:22 | |
| directxman12 | jogo: that's probably your issue -- if you look at the above link, the way it works is that the libvirt daemon uses the uri provided to connect to the other libvirt daemon | 18:23 |
| jogo | directxman12: that make sense as ssh is used elsewhere and working | 18:25 |
| adam_g | jogo, ubuntu@(166.78.143.58, 166.78.62.51) theres a tmux session running on the first | 18:25 |
| *** aix has quit IRC | 18:25 | |
| directxman12 | jogo: so I'd just make sure whomever libvirtd is running as can SSH to the target user (you probably just want to SSH into the same user to keep it simple) | 18:26 |
| jogo | root 19582 1 19582 0.5 0.1 820416 14760 /usr/sbin/libvirtd -d | 18:27 |
| adam_g | jogo, devstack hasn't been run there yet | 18:28 |
| sdague | mtreinish: you should put xml death on the project meeting for today | 18:29 |
| jogo | adam_g: ahh | 18:29 |
| sdague | because the patches seem to be passing | 18:29 |
| jogo | directxman12: so virsh -c 'qemu+ssh:// seems to be working | 18:30 |
| jogo | adam_g: is ssh as root set up? | 18:31 |
| adam_g | jogo, no | 18:31 |
| jogo | adam_g: good | 18:31 |
| *** patrickeast has joined #openstack-qa | 18:31 | |
| jogo | adam_g: as that is the user running libvirt | 18:31 |
| jogo | according to http://logs.openstack.org/04/136504/3/experimental/check-tempest-dsvm-aiopcpu/f7eea47/logs/10.208.35.18/ps.txt.gz | 18:31 |
| adam_g | jogo, do you have any patches to devstack that should be pulled in before kicking it off? | 18:31 |
| jogo | adam_g: just yours 136197 | 18:32 |
| jogo | adam_g: btw how was I able to log in to that machine? did you use my public key? | 18:32 |
| mtreinish | sdague: I did that yesterday | 18:33 |
| adam_g | jogo, yeah, 'ssh-import-id jogo' | 18:33 |
| *** salv-orlando has joined #openstack-qa | 18:33 | |
| *** nmagnezi has quit IRC | 18:33 | |
| *** ranger81 has joined #openstack-qa | 18:33 | |
| jogo | adam_g: nice trick I didn't know about that | 18:34 |
| adam_g | jogo, yeah, its super handy | 18:34 |
| adam_g | well, among people who use launchpad | 18:34 |
| directxman12 | jogo: so the options are to either make root be able to SSH into stack, or test using a different SSH setup. | 18:34 |
| jogo | directxman12: if the test env we are using doesn't have ssh as root set up | 18:35 |
| clarkb | root ability to ssh as stack is easy to set up | 18:35 |
| clarkb | jogo: it does | 18:35 |
| jogo | directxman12: but "virsh -c 'qemu+ssh://" seems to be working | 18:35 |
| clarkb | jogo: thats how it works | 18:35 |
| *** rushiagr_away is now known as rushiagr | 18:36 | |
| clarkb | hrm unless I am mixing up jobs | 18:36 |
| clarkb | in any case root to stack should be simple | 18:36 |
| jogo | clarkb: yeah and easy to test if it set up or not | 18:36 |
| directxman12 | jogo: FWIW, I generally reccomend using TLS auth instead. It sidesteps some of the issues involved with SSH | 18:37 |
| clarkb | you still have to set up kes | 18:37 |
| clarkb | certs | 18:37 |
| clarkb | it just comes with different problems | 18:37 |
| clarkb | or am I mixing up auth methods? | 18:37 |
| directxman12 | clarkb: you need TLS certs set up, but it only applies for libvirt, and you don't need to worry about root being able to SSH root, etc | 18:38 |
| clarkb | we don't need root to ssh as root aiui | 18:38 |
| directxman12 | clarkb: *root being able to SSH into anybody | 18:38 |
| directxman12 | clarkb: sorry, mistype | 18:38 |
| clarkb | we need root to ssh as a user that is in the libvirt group | 18:38 |
| clarkb | that is super simple to set up | 18:38 |
| directxman12 | clarkb: yep | 18:38 |
| clarkb | since we already have that in the test setup | 18:38 |
| directxman12 | clarkb: I mistyped | 18:38 |
| clarkb | supporting TLS would require completely new stuff | 18:39 |
| directxman12 | clarkb: fair enough | 18:39 |
| clarkb | which is probably worth doing at some point but imo the first and easiest thing to do is ssh | 18:39 |
| *** yfried has quit IRC | 18:40 | |
| *** yfried has joined #openstack-qa | 18:40 | |
| *** dimtruck is now known as zz_dimtruck | 18:41 | |
| jogo | directxman12: this is the current error we are seeing | 18:41 |
| jogo | http://logs.openstack.org/04/136504/3/experimental/check-tempest-dsvm-aiopcpu/f7eea47/logs/screen-n-cpu.txt.gz?level=TRACE#_2014-11-25_06_42_58_998 | 18:41 |
| jogo | 'Live Migration failure: operation failed: Failed to connect to remote libvirt URI qemu+ssh://stack@devstack-trusty-2-node-rax-dfw-3210485-414.slave.openstack.org/system: Cannot recv data: Permission denied (publickey).: Connection reset by peer | 18:41 |
| jogo | so that means libvirt is trying to ssh from root into stack? | 18:42 |
| jogo | and failing | 18:42 |
| clarkb | ya so all you need to do is put private key in ~root and pubkey in stack authorized_keys | 18:43 |
| openstackgerrit | Alok Kumar Maurya proposed openstack/tempest: Basic networks Scenario Test Enhancements https://review.openstack.org/106620 | 18:43 |
| directxman12 | jogo: yep | 18:43 |
| *** bkopilov has quit IRC | 18:45 | |
| directxman12 | jogo: and then you could `sudo virsh -c 'qemu+ssh://stack@xyz/system'` to double check | 18:45 |
| directxman12 | jogo: after keys are deployed, etc | 18:45 |
| jogo | clarkb: like this? http://paste.openstack.org/show/138316 | 18:46 |
| jogo | adam_g: trying directxman12's command | 18:46 |
| *** achanda has joined #openstack-qa | 18:47 | |
| *** nfedotov has joined #openstack-qa | 18:47 | |
| *** mkollaro has quit IRC | 18:51 | |
| openstackgerrit | Alok Kumar Maurya proposed openstack/tempest: Basic networks Scenario Test Enhancements https://review.openstack.org/106620 | 18:52 |
| adam_g | jogo, stacking is done, theres an instance running on multi2. have at it | 18:52 |
| *** achanda_ has joined #openstack-qa | 18:52 | |
| *** achanda has quit IRC | 18:52 | |
| *** johnthetubaguy is now known as zz_johnthetubagu | 18:53 | |
| mestery | Hi QA folks! I just need one more core for this simple patch which enables us to move back to restoring the OpenDaylight CI: https://review.openstack.org/#/c/134309/ Any takers? Thanks! | 18:54 |
| jogo | adam_g: just produced the expected error | 18:57 |
| adam_g | jogo, cool | 18:57 |
| *** harlowja is now known as harlowja_away | 18:58 | |
| adam_g | jogo, are you gonna auth root<->root ? | 18:58 |
| *** mwagner_lap has quit IRC | 18:59 | |
| directxman12 | jogo: did it work? | 18:59 |
| jogo | directxman12: yes! | 19:00 |
| jogo | added the same key to root and it worked | 19:00 |
| directxman12 | jogo: good. Glad I could help. | 19:01 |
| sdague | mtreinish: also at the top of the stack of patches, we get to drop lxml from tempest - https://review.openstack.org/#/c/137113/ | 19:01 |
| jogo | directxman12: thanks | 19:01 |
| jogo | hmm migration back failed | 19:01 |
| jogo | oh I think I know why though | 19:01 |
| directxman12 | jogo: did you set up the keys to got the other way? | 19:01 |
| jogo | directxman12: host key failed | 19:02 |
| jogo | manually fixed that | 19:03 |
| jogo | looks like migration back is working | 19:03 |
| adam_g | jogo, oh yeah-i didnt prep /etc/ssh with that stuff | 19:03 |
| adam_g | but cool | 19:03 |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: DO NOT MERGE: testing aiopcpu with tempest full https://review.openstack.org/136504 | 19:03 |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: Add ssh key to root user https://review.openstack.org/137176 | 19:03 |
| directxman12 | jogo: ok, good | 19:03 |
| *** achanda_ has quit IRC | 19:04 | |
| jogo | although I may have found an error in the tempest test | 19:04 |
| jogo | live migrate doesn't happen right away | 19:04 |
| *** achanda has joined #openstack-qa | 19:04 | |
| jogo | and the host status isn't changed instantly | 19:04 |
| *** achanda has quit IRC | 19:05 | |
| jogo | although migrating status does | 19:06 |
| sdague | jogo: it is completely unsurprising that there are bugs in a test which isn't run :) | 19:07 |
| *** achanda has joined #openstack-qa | 19:07 | |
| jogo | sdague: actually the test may be OK | 19:07 |
| *** harlowja_away is now known as harlowja | 19:07 | |
| jogo | sdague: it waits for ACTIVE state | 19:07 |
| directxman12 | jogo: hmm... it should happen pretty quickly, although depending on several factors it might take a little bit to finish up | 19:07 |
| jogo | but we will find out soon | 19:07 |
| directxman12 | jogo: (the live migration itself, that is) | 19:08 |
| jogo | directxman12: yeah live migration takes <1 minute in my test | 19:08 |
| jogo | but > 1 second | 19:08 |
| yfried | salv-orlando: ping | 19:09 |
| salv-orlando | aloha yfried | 19:09 |
| yfried | salv-orlando: you are familiar with the floating-ip op-status (I believe you are the one who implemented it), right | 19:10 |
| jogo | directxman12: thanks again for your help | 19:11 |
| jogo | that saved a lot of debugging | 19:11 |
| *** markmcclain has joined #openstack-qa | 19:11 | |
| yfried | salv-orlando: if the router is going down (set admin_state_up=False) by admin, shouldn't fip-op-status be DOWN as well? | 19:11 |
| yfried | markmcclain: ^ | 19:11 |
| jogo | testing it all together now: https://jenkins02.openstack.org/job/check-tempest-dsvm-aiopcpu/33/console | 19:11 |
| directxman12 | jogo: no problem. I'm always glad to help | 19:12 |
| jogo | clarkb: btw I am still seeing the second node not be sshable fairly often | 19:12 |
| clarkb | jogo: ya I think thats a nodepool bug | 19:12 |
| clarkb | pretty low on the priority list right now | 19:12 |
| jogo | kk long as its known | 19:13 |
| markmcclain | yfried: eventually yes, but right now I don't believe that properly happens | 19:13 |
| clarkb | I think nodepool is deleting the subnode before deleting the primary node | 19:13 |
| jogo | clarkb: I think we are realistically at least a week or two off from even considering moving this test out of experimental | 19:13 |
| clarkb | just need to change order of ops so that primary node is removed from jenkins first | 19:14 |
| markmcclain | yfried: for Kilo we're working on correcting issues like that | 19:14 |
| yfried | markmcclain: should I file a bug on it? | 19:14 |
| clarkb | jogo: I disagree. I agree on your migration stuff though | 19:14 |
| clarkb | jogo: but thats one test out of a bunch | 19:14 |
| markmcclain | yfried: I think we've already got one for it | 19:14 |
| jogo | clarkb: true, the smoke test version is pretty solid | 19:15 |
| yfried | markmcclain: are you sure? | 19:15 |
| *** btran has joined #openstack-qa | 19:15 | |
| markmcclain | yfried: not a 100%, but that class of problem is one we're working to fix in the API refactoring work | 19:16 |
| yfried | markmcclain: I'm filing a bug. feel free to mark as duplicate. it should serve for a test that we are working on | 19:16 |
| *** achanda_ has joined #openstack-qa | 19:19 | |
| *** achanda has quit IRC | 19:20 | |
| *** X019 has quit IRC | 19:20 | |
| markmcclain | yfried: that sounds good | 19:21 |
| yfried | markmcclain: https://bugs.launchpad.net/neutron/+bug/1396310 | 19:22 |
| openstackgerrit | Joshua Harlow proposed openstack-infra/elastic-recheck: Add query for bug 1395368 https://review.openstack.org/136657 | 19:23 |
| jogo | clarkb: example failure https://jenkins02.openstack.org/job/check-tempest-dsvm-aiopcpu/33/console | 19:26 |
| jogo | clarkb: and neutron version failed for same reason | 19:27 |
| yfried | markmcclain: salv-orlando your review of this test would help raise its profile. it's a pretty simple one https://review.openstack.org/#/c/106620/7 | 19:27 |
| clarkb | jogo: just use the ssh keys provided by nodepool | 19:27 |
| clarkb | jogo: they are already one every host | 19:28 |
| jogo | clarkb: derp | 19:28 |
| jogo | clarkb: that was my bug | 19:28 |
| jogo | clarkb: and its the same on all machines? | 19:31 |
| clarkb | yes | 19:31 |
| *** suneelb has quit IRC | 19:31 | |
| *** suneelb has joined #openstack-qa | 19:31 | |
| *** suneelb has quit IRC | 19:32 | |
| *** matrohon has joined #openstack-qa | 19:32 | |
| *** suneelb has joined #openstack-qa | 19:34 | |
| *** mwagner_lap has joined #openstack-qa | 19:35 | |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: DO NOT MERGE: testing aiopcpu with tempest full https://review.openstack.org/136504 | 19:36 |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: Add ssh key to root user https://review.openstack.org/137176 | 19:36 |
| jogo | clarkb: ^ | 19:36 |
| *** adalbas has quit IRC | 19:37 | |
| *** matrohon has quit IRC | 19:37 | |
| *** matrohon has joined #openstack-qa | 19:38 | |
| *** tosky has quit IRC | 19:40 | |
| *** mkollaro has joined #openstack-qa | 19:44 | |
| *** directxman12 has quit IRC | 19:44 | |
| openstackgerrit | Andrew Laski proposed openstack/tempest: Expand service validation to work for Nova cells https://review.openstack.org/137181 | 19:47 |
| *** ranger81 has quit IRC | 19:48 | |
| *** toure has quit IRC | 19:48 | |
| *** achanda_ has quit IRC | 19:49 | |
| yfried | mtreinish: ping | 19:53 |
| openstackgerrit | Yair Fried proposed openstack/tempest: Adds scenario for network-large-ops https://review.openstack.org/136789 | 19:54 |
| *** matrohon has quit IRC | 19:54 | |
| mtreinish | yfried: pong | 19:58 |
| yfried | mtreinish: https://review.openstack.org/136789 | 19:58 |
| yfried | mtreinish: this requires a new gate | 19:59 |
| openstackgerrit | Alok Kumar Maurya proposed openstack/tempest: Basic networks Scenario Test Enhancements https://review.openstack.org/106620 | 19:59 |
| yfried | mtreinish: is it possible to add one as a non-voting? | 20:00 |
| yfried | mtreinish: I'm unfamiliar with the process | 20:00 |
| *** ranger81 has joined #openstack-qa | 20:00 | |
| yfried | mtreinish: I would also like to see it replace the large-ops-neutron gates... | 20:00 |
| *** suneelb has quit IRC | 20:01 | |
| mtreinish | yfried: yes, you can add it non-voting, But I'm not sure we want that running everywhere. What are you trying to catch with that test? | 20:01 |
| mtreinish | jogo: ^^^ | 20:01 |
| *** suneelb has joined #openstack-qa | 20:02 | |
| yfried | mtreinish: see that neutron<->nova ops are able to handle multiple boot operations | 20:03 |
| yfried | mtreinish: I'm not sure that 100 is the "sweet spot" for this. I'd settle for 50 and count my blessing if it passes | 20:04 |
| yfried | mtreinish: this would be a good job to run in periodic post merge jobs we've discussed in Paris as it stresses both components greatly | 20:05 |
| mtreinish | yfried: so I understand that goal, but we can barely handle the like 10 we do during a normal gate run, and ssh failures are almost impossible to debug | 20:05 |
| mtreinish | I don't think this is something we want to run as part of check or gate, you can probably add it as an experimental job on neutron (and maybe tempest and nova) | 20:05 |
| yfried | mtreinish: agreed | 20:06 |
| *** achanda has joined #openstack-qa | 20:07 | |
| yfried | mtreinish: but If we get stuck on ssh, that would be great. this would mean that all VMs have reached ACTIVE state with network | 20:07 |
| *** andreykurilin_ has quit IRC | 20:07 | |
| *** andreykurilin_ has joined #openstack-qa | 20:08 | |
| *** aysyd has quit IRC | 20:08 | |
| yfried | mtreinish: also, there's a tricky issue I've never logged because I as unable to properly document it - booting multiple VMs occasionally results in key injection issues. having this as non-voting job would help us/me track this better | 20:09 |
| yfried | mtreinish: ^ this could be the source of the gate ssh issues that comes and goes | 20:10 |
| *** shashankhegde has quit IRC | 20:10 | |
| *** om has joined #openstack-qa | 20:10 | |
| yfried | mtreinish: so, since the current gate won't run this job, what's the process? do we merge it and then create a gate for it in devsatck-gate or is there another flow? | 20:11 |
| mtreinish | yfried: it can't land until it's shown running somewhere by a ci system | 20:11 |
| *** achanda has quit IRC | 20:11 | |
| mtreinish | so you add the job as experimental | 20:12 |
| mtreinish | then show it works there and it'll be able to land | 20:12 |
| *** achanda has joined #openstack-qa | 20:12 | |
| yfried | mtreinish: but in order for it to be added as experimental it needs to land first, doesn't it??? | 20:12 |
| *** mwagner_lap has quit IRC | 20:13 | |
| yfried | mtreinish: how did you add the "large-ops" jobs to begin with? | 20:13 |
| *** mwagner_lap has joined #openstack-qa | 20:13 | |
| *** jgrimm is now known as zz_jgrimm | 20:13 | |
| mtreinish | yfried: you just add a job definition to the openstack-infra/project-config repo | 20:14 |
| yfried | mtreinish: but will it land there, if the test doesn't exist? | 20:15 |
| yfried | mtreinish: do you have an example? | 20:15 |
| sdague | mtreinish: is there an across the board fix for the SG race? | 20:15 |
| mtreinish | yfried: its just a configuration repo, it doesn't run tempest | 20:16 |
| mtreinish | sdague: which sg race? But, my guess is no :) | 20:16 |
| sdague | the not waiting for sg to apply before we try to test connectivity | 20:16 |
| mtreinish | sdague: oh, yeah I just added a wait to the test for that, it seemed to fix the issue clarkb was seeing in multinode testing | 20:17 |
| sdague | right, so I believe it's part of the issue we see in other tests | 20:17 |
| sdague | so I'd like to see it addressed everywhere if possible | 20:17 |
| mtreinish | sdague: http://git.openstack.org/cgit/openstack/tempest/commit/?id=ff31bccce8f166d43e351e85a2e13d8d52779772 | 20:17 |
| sdague | ok, but what about all the other tests that do that? | 20:18 |
| yfried | mtreinish: dou you have an example for the experimental patch? | 20:18 |
| mtreinish | sdague: I think it was specific to that test adding a sg to an already booted instance | 20:18 |
| *** zz_jgrimm is now known as jgrimm | 20:18 | |
| mtreinish | IIRC the other tests set it before boot | 20:18 |
| mtreinish | yfried: you'll have to give me a min to dig one up from the git log | 20:19 |
| mtreinish | yfried: you can just look at the git log for examples too | 20:19 |
| *** jgrimm is now known as zz_jgrimm | 20:19 | |
| yfried | mtreinish: tnx | 20:19 |
| sdague | mtreinish: ah, ok | 20:19 |
| *** achanda has quit IRC | 20:19 | |
| mtreinish | sdague: I would double check though, I might be wrong | 20:20 |
| *** achanda has joined #openstack-qa | 20:21 | |
| *** rushiagr is now known as rushiagr_away | 20:22 | |
| *** andreykurilin_ has quit IRC | 20:24 | |
| *** andreykurilin_ has joined #openstack-qa | 20:24 | |
| *** achanda has quit IRC | 20:24 | |
| *** achanda has joined #openstack-qa | 20:25 | |
| yfried | mtreinish: I see how to add an existing job the the experimental part. but how do I create a job? I'm no too familiar with JJB | 20:27 |
| *** ranger81 has quit IRC | 20:29 | |
| yfried | jogo: maybe you are familiar with the process of creating a new job (experimental) in openstack-infra/project-config? | 20:31 |
| openstackrecheck | openstack-dev/devstack change: https://review.openstack.org/136215 failed because of: gate-grenade-dsvm-partial-ncpu: unrecognized error, gate-tempest-dsvm-neutron-full: https://bugs.launchpad.net/bugs/1373513 | 20:33 |
| *** e0ne has joined #openstack-qa | 20:45 | |
| *** nfedotov has left #openstack-qa | 20:45 | |
| *** mlavalle has joined #openstack-qa | 20:49 | |
| *** dpaterson has joined #openstack-qa | 20:52 | |
| *** zz_jgrimm is now known as jgrimm | 20:53 | |
| openstackgerrit | Merged openstack-dev/devstack: switch to use ceilometer specific connections https://review.openstack.org/135715 | 20:53 |
| *** yfried is now known as yfried|afk | 20:53 | |
| *** jgrimm is now known as zz_jgrimm | 20:53 | |
| *** om has quit IRC | 20:54 | |
| *** shashankhegde has joined #openstack-qa | 20:55 | |
| openstackgerrit | Merged openstack-dev/devstack: Install bash completion for glanceclient https://review.openstack.org/135941 | 21:01 |
| *** yfried|afk is now known as yfried | 21:02 | |
| openstackrecheck | openstack/cinder change: https://review.openstack.org/132698 failed because of: gate-tempest-dsvm-postgres-full: https://bugs.launchpad.net/bugs/1353962 | 21:03 |
| jgriffith | sdague: you or anybody have a lead on the clients failing for neutron on stable/icehouse? | 21:06 |
| *** yfried has quit IRC | 21:07 | |
| mtreinish | jgriffith: https://review.openstack.org/#/c/135903/ should fix it | 21:07 |
| jgriffith | mtreinish: ahh.. very nice | 21:08 |
| jgriffith | mtreinish: thanks! | 21:08 |
| *** ranger81 has joined #openstack-qa | 21:08 | |
| jogo | got live migrate working (partially) | 21:10 |
| mtreinish | jogo: what's partially? | 21:10 |
| jogo | mtreinish: working on one direction | 21:10 |
| jogo | messed up the permissions of the ssh keys in the other direction | 21:10 |
| mtreinish | ah, ok | 21:10 |
| jogo | mtreinish: http://logs.openstack.org/04/136504/5/experimental/check-tempest-dsvm-aiopcpu/344a169/logs/testr_results.html.gz | 21:11 |
| salv-orlando | yfried: a miracle happened and I reviewed a patch you requested (https://review.openstack.org/#/c/106620/) in less than 2 hours from your request | 21:15 |
| *** X019 has joined #openstack-qa | 21:17 | |
| *** jamielennox is now known as jamielennox|away | 21:23 | |
| *** dkranz has quit IRC | 21:25 | |
| *** achanda has quit IRC | 21:28 | |
| jogo | clarkb: cp: cannot stat ‘/etc/nodepool/id_rsa’: No such file or directory | 21:28 |
| jogo | clarkb: is id_rsa on both machines? or only one? | 21:28 |
| *** jamielennox|away is now known as jamielennox | 21:28 | |
| openstackgerrit | Sean M. Collins proposed openstack-dev/devstack: lib/ironic: Ensure sgabios package is installed before use https://review.openstack.org/137216 | 21:30 |
| clarkb | should be all I thought. check docs | 21:32 |
| *** X019 has quit IRC | 21:32 | |
| *** zz_jgrimm is now known as jgrimm | 21:32 | |
| jogo | clarkb: docs and code point to it being both | 21:34 |
| jogo | but i don't know the codebase very well | 21:34 |
| jogo | maybe something is wrong with my code: https://review.openstack.org/#/c/137176/2/sub_node_prepare.sh,cm | 21:36 |
| *** toure_ has joined #openstack-qa | 21:40 | |
| *** toure_ has quit IRC | 21:40 | |
| *** ajo has quit IRC | 21:41 | |
| openstackgerrit | Merged openstack/tempest: rm pyc files before test runs https://review.openstack.org/137055 | 21:44 |
| *** e0ne has quit IRC | 21:47 | |
| *** ajo has joined #openstack-qa | 21:50 | |
| openstackgerrit | Sergey Lukjanov proposed openstack-dev/devstack: Explicitly set Sahara service type to change it https://review.openstack.org/137220 | 21:51 |
| *** matrohon has joined #openstack-qa | 21:53 | |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: DO NOT MERGE: testing aiopcpu with tempest full https://review.openstack.org/136504 | 21:54 |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: Add ssh key to root user https://review.openstack.org/137176 | 21:54 |
| openstackgerrit | Adam Gandelman proposed openstack-infra/devstack-gate: Enable nova-api-metadata for multi host nova-network https://review.openstack.org/136179 | 22:14 |
| *** matrohon has quit IRC | 22:16 | |
| openstackgerrit | Adam Gandelman proposed openstack-infra/devstack-gate: Enable nova-api-metadata for multi host nova-network https://review.openstack.org/136179 | 22:16 |
| *** dimsum__ has quit IRC | 22:16 | |
| *** dimsum__ has joined #openstack-qa | 22:17 | |
| *** melwitt has quit IRC | 22:17 | |
| *** melwitt has joined #openstack-qa | 22:18 | |
| *** JayJ has joined #openstack-qa | 22:18 | |
| *** yamamoto has joined #openstack-qa | 22:21 | |
| *** dimsum__ has quit IRC | 22:21 | |
| openstackgerrit | Ian Wienand proposed openstack-dev/devstack: Move sgabios setup to hypervisor-ironic https://review.openstack.org/136436 | 22:22 |
| *** yamamoto has quit IRC | 22:25 | |
| *** achanda has joined #openstack-qa | 22:28 | |
| *** mkollaro has quit IRC | 22:37 | |
| *** achanda has quit IRC | 22:39 | |
| *** e0ne has joined #openstack-qa | 22:42 | |
| *** e0ne has quit IRC | 22:42 | |
| openstackgerrit | Dolph Mathews proposed openstack-infra/elastic-recheck: add CLI command for executing queries https://review.openstack.org/137234 | 22:47 |
| *** dims_ has joined #openstack-qa | 22:49 | |
| adam_g | jogo, you done with those cloud instances, gonna repurpose them | 22:50 |
| *** dustins has quit IRC | 22:52 | |
| *** enikanorov_ has quit IRC | 23:01 | |
| *** enikanorov_ has joined #openstack-qa | 23:01 | |
| *** andreykurilin_ has quit IRC | 23:01 | |
| openstackgerrit | Dolph Mathews proposed openstack-infra/elastic-recheck: add CLI command for executing elastic-recheck queries https://review.openstack.org/137234 | 23:01 |
| openstackgerrit | Chmouel Boudjnah proposed openstack/qa-specs: Add devstack external plugin spec https://review.openstack.org/137054 | 23:02 |
| *** shashankhegde_ has joined #openstack-qa | 23:03 | |
| *** achanda has joined #openstack-qa | 23:03 | |
| openstackgerrit | Chmouel Boudjnah proposed openstack/qa-specs: Add devstack external plugin spec https://review.openstack.org/137054 | 23:03 |
| openstackgerrit | Dolph Mathews proposed openstack-infra/elastic-recheck: add CLI command for executing elastic-recheck queries https://review.openstack.org/137234 | 23:05 |
| *** shashankhegde has quit IRC | 23:06 | |
| *** shashankhegde_ is now known as shashankhegde | 23:06 | |
| *** mlavalle has quit IRC | 23:09 | |
| *** gfidente has quit IRC | 23:12 | |
| openstackgerrit | Adam Gandelman proposed openstack/qa-specs: Improve diskimage-builder in devstack https://review.openstack.org/136101 | 23:12 |
| *** markmcclain1 has joined #openstack-qa | 23:15 | |
| *** markmcclain has quit IRC | 23:15 | |
| *** achanda has quit IRC | 23:17 | |
| jogo | adam_g: go for it, thanks | 23:22 |
| *** achanda has joined #openstack-qa | 23:23 | |
| *** X019 has joined #openstack-qa | 23:28 | |
| *** markmcclain1 has quit IRC | 23:29 | |
| *** markmcclain has joined #openstack-qa | 23:29 | |
| *** markmcclain has quit IRC | 23:30 | |
| openstackgerrit | Sergey Shnaidman proposed openstack/tempest: Support for IPv6 for API continue https://review.openstack.org/137239 | 23:36 |
| openstackgerrit | Sergey Shnaidman proposed openstack/tempest: Support for IPv6 for API continue https://review.openstack.org/137239 | 23:39 |
| *** tochi has joined #openstack-qa | 23:39 | |
| *** shashankhegde has quit IRC | 23:42 | |
| *** X019 has quit IRC | 23:46 | |
| *** oomichi has joined #openstack-qa | 23:46 | |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: DO NOT MERGE: testing aiopcpu with tempest full https://review.openstack.org/136504 | 23:47 |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: Set up ssh_known_host based on hostname https://review.openstack.org/136596 | 23:47 |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: Setup /etc/hosts for aiopcpu https://review.openstack.org/136158 | 23:47 |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: Add ssh key to root user https://review.openstack.org/137176 | 23:47 |
| jogo | that should do it | 23:47 |
| jogo | adam_g: I think I am very close if not there | 23:48 |
| adam_g | jogo, nice | 23:48 |
| *** melwitt has quit IRC | 23:50 | |
| openstackgerrit | Sergey Shnaidman proposed openstack/tempest: Support for IPv6 for API continue https://review.openstack.org/137239 | 23:51 |
| openstackgerrit | Sergey Shnaidman proposed openstack/tempest: Support for IPv6 for API continue https://review.openstack.org/137239 | 23:52 |
| *** ajo has quit IRC | 23:54 | |
| *** rbak has quit IRC | 23:55 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!