| *** ryohayakawa has joined #openstack-infra | 00:01 | |
| *** tetsuro has joined #openstack-infra | 00:22 | |
| *** markvoelker has joined #openstack-infra | 00:29 | |
| *** markvoelker has quit IRC | 00:33 | |
| *** ricolin has quit IRC | 00:41 | |
| *** rfolco has quit IRC | 00:51 | |
| *** markvoelker has joined #openstack-infra | 01:12 | |
| *** markvoelker has quit IRC | 01:17 | |
| openstackgerrit | Pierre-Louis Bonicoli proposed zuul/zuul-jobs master: Avoid to use 'length' filter with null value https://review.opendev.org/742316 | 01:28 |
|---|---|---|
| openstackgerrit | Pierre-Louis Bonicoli proposed zuul/zuul-jobs master: Avoid to use 'length' filter with null value https://review.opendev.org/742316 | 01:32 |
| *** pots has quit IRC | 02:26 | |
| *** pots has joined #openstack-infra | 02:27 | |
| *** markvoelker has joined #openstack-infra | 02:28 | |
| *** jistr has quit IRC | 02:28 | |
| *** jistr has joined #openstack-infra | 02:28 | |
| *** markvoelker has quit IRC | 02:32 | |
| *** ricolin_ has joined #openstack-infra | 02:41 | |
| *** ricolin_ has quit IRC | 02:46 | |
| *** ricolin_ has joined #openstack-infra | 02:46 | |
| *** tetsuro_ has joined #openstack-infra | 02:49 | |
| *** tetsuro has quit IRC | 02:52 | |
| *** tetsuro_ has quit IRC | 02:53 | |
| *** adriant has quit IRC | 03:13 | |
| *** slaweq_ has joined #openstack-infra | 03:22 | |
| *** slaweq has quit IRC | 03:24 | |
| *** ricolin_ has quit IRC | 03:25 | |
| *** ddurst has quit IRC | 03:28 | |
| *** ddurst has joined #openstack-infra | 03:28 | |
| *** psachin has joined #openstack-infra | 03:37 | |
| *** d34dh0r53 has joined #openstack-infra | 03:43 | |
| *** ociuhandu has joined #openstack-infra | 03:53 | |
| *** ociuhandu has quit IRC | 03:57 | |
| *** dave-mccowan has quit IRC | 04:04 | |
| *** tetsuro has joined #openstack-infra | 04:11 | |
| *** markvoelker has joined #openstack-infra | 04:28 | |
| *** ykarel|away has joined #openstack-infra | 04:29 | |
| *** ykarel|away is now known as ykarel | 04:30 | |
| *** rcernin has quit IRC | 04:31 | |
| *** evrardjp has quit IRC | 04:33 | |
| *** raukadah is now known as chkumar|rover | 04:33 | |
| *** evrardjp has joined #openstack-infra | 04:33 | |
| *** markvoelker has quit IRC | 04:33 | |
| *** Goneri has quit IRC | 04:44 | |
| *** lmiccini has joined #openstack-infra | 04:48 | |
| *** markvoelker has joined #openstack-infra | 04:52 | |
| *** rcernin has joined #openstack-infra | 04:52 | |
| *** markvoelker has quit IRC | 04:56 | |
| *** Tengu has quit IRC | 05:04 | |
| *** Tengu has joined #openstack-infra | 05:06 | |
| *** udesale has joined #openstack-infra | 05:14 | |
| *** yolanda has quit IRC | 05:56 | |
| *** yolanda has joined #openstack-infra | 05:58 | |
| *** Tengu has quit IRC | 05:58 | |
| *** Tengu has joined #openstack-infra | 06:00 | |
| *** tetsuro has quit IRC | 06:01 | |
| *** ramishra has joined #openstack-infra | 06:04 | |
| *** Tengu has quit IRC | 06:05 | |
| *** Tengu has joined #openstack-infra | 06:06 | |
| *** tetsuro has joined #openstack-infra | 06:08 | |
| *** eolivare has joined #openstack-infra | 06:11 | |
| *** ryo_hayakawa has joined #openstack-infra | 06:12 | |
| *** ysandeep|away is now known as ysandeep | 06:13 | |
| *** tetsuro has quit IRC | 06:14 | |
| *** ryohayakawa has quit IRC | 06:14 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/project-config master: Normalize projects.yaml https://review.opendev.org/744096 | 06:28 |
| *** ykarel_ has joined #openstack-infra | 06:31 | |
| *** rhayakaw__ has joined #openstack-infra | 06:32 | |
| *** ykarel has quit IRC | 06:32 | |
| *** ryo_hayakawa has quit IRC | 06:34 | |
| *** markvoelker has joined #openstack-infra | 06:53 | |
| *** jcapitao has joined #openstack-infra | 06:58 | |
| *** markvoelker has quit IRC | 06:58 | |
| *** dciabrin has joined #openstack-infra | 07:01 | |
| *** nightmare_unreal has joined #openstack-infra | 07:03 | |
| *** Tengu has quit IRC | 07:04 | |
| *** Tengu has joined #openstack-infra | 07:05 | |
| *** ricolin_ has joined #openstack-infra | 07:12 | |
| *** slaweq_ has quit IRC | 07:13 | |
| *** slaweq has joined #openstack-infra | 07:13 | |
| *** Lucas_Gray has joined #openstack-infra | 07:19 | |
| *** slaweq has quit IRC | 07:21 | |
| *** slaweq has joined #openstack-infra | 07:22 | |
| *** slaweq has quit IRC | 07:22 | |
| *** slaweq has joined #openstack-infra | 07:22 | |
| *** ricolin_ has quit IRC | 07:23 | |
| *** ricolin has joined #openstack-infra | 07:24 | |
| *** Tengu has quit IRC | 07:24 | |
| *** frickler_pto is now known as frickler | 07:26 | |
| *** Tengu has joined #openstack-infra | 07:26 | |
| *** tetsuro has joined #openstack-infra | 07:33 | |
| *** tosky has joined #openstack-infra | 07:35 | |
| *** hashar has joined #openstack-infra | 07:38 | |
| *** ociuhandu has joined #openstack-infra | 07:40 | |
| *** ysandeep is now known as ysandeep|lunch | 07:44 | |
| *** udesale_ has joined #openstack-infra | 07:48 | |
| *** ykarel_ is now known as ykarel | 07:49 | |
| *** udesale has quit IRC | 07:50 | |
| *** udesale has joined #openstack-infra | 07:54 | |
| *** udesale_ has quit IRC | 07:55 | |
| *** jpena|off is now known as jpena | 07:56 | |
| *** tetsuro has quit IRC | 07:57 | |
| *** sshnaidm|afk is now known as sshnaidm | 07:58 | |
| *** ttx has quit IRC | 08:00 | |
| *** ttx has joined #openstack-infra | 08:01 | |
| *** xek has joined #openstack-infra | 08:09 | |
| *** dtantsur|afk is now known as dtantsur | 08:10 | |
| *** pkopec has joined #openstack-infra | 08:17 | |
| *** Tengu has quit IRC | 08:25 | |
| *** Tengu has joined #openstack-infra | 08:26 | |
| *** ysandeep|lunch is now known as ysandeep | 08:27 | |
| *** Tengu has quit IRC | 08:28 | |
| *** Tengu has joined #openstack-infra | 08:29 | |
| *** Lucas_Gray has quit IRC | 08:35 | |
| *** Lucas_Gray has joined #openstack-infra | 08:48 | |
| *** markvoelker has joined #openstack-infra | 08:55 | |
| *** markvoelker has quit IRC | 08:59 | |
| *** Lucas_Gray has quit IRC | 09:13 | |
| *** jcap has joined #openstack-infra | 09:16 | |
| *** jcap has quit IRC | 09:16 | |
| *** jcapitao has quit IRC | 09:17 | |
| *** jcapitao has joined #openstack-infra | 09:17 | |
| *** Lucas_Gray has joined #openstack-infra | 09:25 | |
| *** hashar has quit IRC | 09:28 | |
| *** ysandeep is now known as ysandeep|afk | 09:41 | |
| *** yamamoto has quit IRC | 10:00 | |
| *** apetrich has joined #openstack-infra | 10:06 | |
| *** dtantsur is now known as dtantsur|brb | 10:09 | |
| *** rcernin has quit IRC | 10:13 | |
| *** tkajinam has quit IRC | 10:13 | |
| *** rcernin has joined #openstack-infra | 10:14 | |
| *** yamamoto has joined #openstack-infra | 10:20 | |
| *** psachin has quit IRC | 10:23 | |
| *** markvoelker has joined #openstack-infra | 10:32 | |
| *** markvoelker has quit IRC | 10:39 | |
| *** xek has quit IRC | 10:42 | |
| *** ysandeep|afk is now known as ysandeep | 10:54 | |
| *** psachin has joined #openstack-infra | 11:01 | |
| *** dchen has quit IRC | 11:02 | |
| *** rcernin has quit IRC | 11:02 | |
| *** rhayakaw__ has quit IRC | 11:05 | |
| *** chkumar|rover is now known as chandankumar | 11:12 | |
| *** chandankumar is now known as chkumar|rover | 11:13 | |
| *** Lucas_Gray has quit IRC | 11:19 | |
| *** jpena is now known as jpena|lunch | 11:21 | |
| *** psachin has quit IRC | 11:29 | |
| *** udesale has quit IRC | 11:30 | |
| *** Lucas_Gray has joined #openstack-infra | 11:31 | |
| *** udesale has joined #openstack-infra | 11:31 | |
| *** ykarel_ has joined #openstack-infra | 11:36 | |
| *** ykarel_ has quit IRC | 11:36 | |
| *** ykarel has quit IRC | 11:38 | |
| *** ykarel has joined #openstack-infra | 11:39 | |
| *** ykarel has quit IRC | 11:42 | |
| *** xek has joined #openstack-infra | 11:42 | |
| *** ykarel has joined #openstack-infra | 11:43 | |
| *** ykarel has quit IRC | 11:48 | |
| *** ykarel has joined #openstack-infra | 11:50 | |
| *** dave-mccowan has joined #openstack-infra | 11:53 | |
| *** rfolco has joined #openstack-infra | 11:54 | |
| *** ykarel has quit IRC | 11:55 | |
| *** ykarel has joined #openstack-infra | 11:57 | |
| *** dtantsur|brb is now known as dtantsur | 11:58 | |
| *** jcapitao is now known as jcapitao_lunch | 12:01 | |
| *** ykarel has quit IRC | 12:02 | |
| *** rlandy has joined #openstack-infra | 12:02 | |
| *** ykarel has joined #openstack-infra | 12:03 | |
| *** _erlon_ has joined #openstack-infra | 12:19 | |
| *** jpena|lunch is now known as jpena | 12:23 | |
| *** yamamoto has quit IRC | 12:33 | |
| *** yamamoto has joined #openstack-infra | 12:51 | |
| *** yamamoto has quit IRC | 12:56 | |
| *** d34dh0r53 has quit IRC | 12:58 | |
| *** haleyb has joined #openstack-infra | 13:06 | |
| *** eharney has joined #openstack-infra | 13:11 | |
| *** dave-mccowan has quit IRC | 13:12 | |
| *** dave-mccowan has joined #openstack-infra | 13:16 | |
| *** jcapitao_lunch is now known as jcapitao | 13:20 | |
| *** yamamoto has joined #openstack-infra | 13:30 | |
| *** ramishra has quit IRC | 13:32 | |
| *** haleyb has quit IRC | 13:36 | |
| *** rcernin has joined #openstack-infra | 13:38 | |
| *** ramishra has joined #openstack-infra | 13:39 | |
| *** yamamoto has quit IRC | 13:42 | |
| *** d34dh0r53 has joined #openstack-infra | 13:53 | |
| *** ramishra_ has joined #openstack-infra | 13:54 | |
| *** ramishra has quit IRC | 13:56 | |
| mwhahaha | clarkb: hey we merged the fixes in master for the caching bits. Are you seeing improved caching results for tripleomaster requests? (ussuri/train backports in process) | 14:03 |
| openstackgerrit | Liam Young proposed openstack/project-config master: Add Ceph iSCSI charm to OpenStack charms https://review.opendev.org/744479 | 14:12 |
| *** jhesketh has quit IRC | 14:14 | |
| *** jhesketh has joined #openstack-infra | 14:16 | |
| zigo | Hello ! Is it normal that my patch has been waiting for 4 hours to get some VMs to run on? (ie: #669395) | 14:27 |
| frickler | zigo: no, we seem to have some issue, currently discussing in #opendev | 14:29 |
| zigo | Thanks. | 14:29 |
| *** rcernin has quit IRC | 14:32 | |
| *** matt_kosut has joined #openstack-infra | 14:35 | |
| *** dklyle has joined #openstack-infra | 14:36 | |
| fungi | zigo: https://zuul.opendev.org/t/openstack/status/ if you want to see the current backlog | 14:41 |
| zigo | fungi: So, I'm guessing it's already fixed, and only there's some backlog, right ? :) | 14:42 |
| zigo | Thanks. | 14:42 |
| fungi | looks like that change is starting to get nodes assigned (26 of 26 jobs have node assignments for that change now) | 14:42 |
| fungi | er, 26 of 36 jobs i mean | 14:43 |
| fungi | neutron sure does run a lot of jobs for each change | 14:43 |
| *** rcernin has joined #openstack-infra | 14:45 | |
| openstackgerrit | Liam Young proposed openstack/project-config master: Add Ceph iSCSI charm to OpenStack charms https://review.opendev.org/744479 | 14:46 |
| *** udesale has quit IRC | 15:03 | |
| *** pkopec has quit IRC | 15:05 | |
| clarkb | zigo: the issue hasn't been fixed but we think we understand it now. We're leaking image objects in our internal nodepool db and that is causing certain operations to be slow. THe leak seems to be caused by a corrupted entry that prevents further processing and cleanup | 15:13 |
| clarkb | anyway plan is to find and clear the corrupted entry and see if nodepool can clean up after itself after | 15:13 |
| *** armax has joined #openstack-infra | 15:14 | |
| *** xek has quit IRC | 15:15 | |
| *** ykarel_ has joined #openstack-infra | 15:28 | |
| *** ykarel has quit IRC | 15:31 | |
| *** ykarel_ is now known as ykarel | 15:31 | |
| *** ociuhandu_ has joined #openstack-infra | 15:32 | |
| *** ociuhandu has quit IRC | 15:33 | |
| *** ysandeep is now known as ysandeep|afk | 15:41 | |
| *** eolivare has quit IRC | 15:49 | |
| *** ericyoung has quit IRC | 15:49 | |
| *** jpena is now known as jpena|off | 15:52 | |
| *** dtantsur is now known as dtantsur|afk | 15:58 | |
| *** pkopec has joined #openstack-infra | 16:00 | |
| zigo | Ok, I'll be patient ! :) | 16:01 |
| *** rcernin has quit IRC | 16:15 | |
| *** hamalq has joined #openstack-infra | 16:16 | |
| *** chkumar|rover is now known as raukadah | 16:18 | |
| clarkb | mwhahaha: I know see cache hits with UA of "python-requests/2.22.0" | 16:18 |
| clarkb | mwhahaha: I think that means your changes are working | 16:19 |
| mwhahaha | ok thanks. working on backporting now | 16:21 |
| elod | hi, it seems that there is some weird thing around upper-constraint/tox_constraint/requirements on stable branches. It seems always the latest upper-constraints.txt is installed since ~2020-07-29 | 16:22 |
| *** jcapitao has quit IRC | 16:22 | |
| elod | any idea what causes this? ^^^ | 16:22 |
| clarkb | s/know/now/ but I think you grokked it :) | 16:22 |
| clarkb | elod: more context would be helpful | 16:22 |
| clarkb | a job log or similar | 16:22 |
| elod | for example in nova stable/ussuri build history, oslo.config should be version 8.0.2, but it's the latest 8.3.X | 16:23 |
| elod | https://zuul.opendev.org/t/openstack/builds?job_name=openstack-tox-py36&pipeline=periodic-stable&branch=stable%2Fussuri&project=openstack%2Fnova | 16:23 |
| elod | let me point some exact line | 16:23 |
| elod | here it is still normal: 07-30, oslo.config==8.0.2 >>> https://zuul.opendev.org/t/openstack/build/bedc563d965948a9a298ccee50bcb0e1/log/job-output.txt#621 | 16:25 |
| elod | here it is already wrong: 08-01, oslo.config==8.3.1 >>> https://zuul.opendev.org/t/openstack/build/e9952191c3e4473a9be16262a17339e5/log/job-output.txt#623 | 16:26 |
| elod | both stable/ussuri, where oslo.config should be 8.0.2 >>> https://opendev.org/openstack/requirements/raw/branch/stable/ussuri/upper-constraints.txt | 16:27 |
| fungi | the jobs seem to be checking out the stable/ussuri branch of openstack/requirements | 16:28 |
| fungi | and passing the direct path for the upper-constraints.txt from that on the pip command line | 16:28 |
| elod | yes, the upper-constraints.txt paths are the same, local repo. and the repo seems to be checked out to ussuri. still it seems to use the file from master :S | 16:31 |
| clarkb | openstack requirements has no ussuri branch | 16:33 |
| clarkb | oh wait nevermind | 16:33 |
| clarkb | (I don't like how gitea renders that it rquires I scroll with a non obvious scrollbar | 16:33 |
| fungi | so it initially installs the correct version: https://zuul.opendev.org/t/openstack/build/bcd83ef7115142b5b4e7b11c3ee81c60/log/tox/py36-1.log#568-569 | 16:34 |
| fungi | i think the problem is the second phase which does `python -m pip install --exists-action w -e .` with no -c: https://zuul.opendev.org/t/openstack/build/bcd83ef7115142b5b4e7b11c3ee81c60/log/tox/py36-2.log | 16:34 |
| fungi | i believe that step is only expected to install the local project and not its dependencies | 16:35 |
| fungi | so maybe needs --no-deps added to the command? | 16:35 |
| fungi | (could be a recent behavior change in pip?) | 16:35 |
| fungi | i suspect this is also related to the ml thread about oslo.cache pulling in incompatible dogpile.cache in lower-constraints jobs | 16:35 |
| *** ysandeep|afk is now known as ysandeep|away | 16:36 | |
| elod | hmmm. sounds logical. maybe the issue comes with pip 20.2 release ? https://pypi.org/project/pip/#history | 16:37 |
| elod | (in periodic it is there since 08-01 jobs, though) | 16:39 |
| fungi | for whatever reason the second phase is not seeing the previously installed oslo.config===8.0.2 as satisfying the oslo.config>=6.1.0 | 16:42 |
| fungi | requirement | 16:42 |
| clarkb | iirc constraints override ranges | 16:43 |
| clarkb | is it possible some dep has a range that isn't satisfied and then running without constraints fixes it? | 16:43 |
| *** tosky has quit IRC | 16:45 | |
| elod | maybe this one is coupled with the issue: "Add a beta version of pip’s next-generation dependency resolver." >>> https://pip.pypa.io/en/stable/news/#id1 | 16:47 |
| elod | "Move pip’s new resolver into beta, remove the --unstable-feature=resolver flag, and enable the --use-feature=2020-resolver flag. The new resolver is significantly stricter and more consistent when it receives incompatible instructions, and reduces support for certain kinds of Constraints Files, so some workarounds and workflows may break." | 16:47 |
| fungi | clarkb: the second phase (where it's upgrading to the wrong version) isn't using constraints at all | 16:48 |
| fungi | necessary to keep the siblings stuff working | 16:48 |
| fungi | but the idea i thought was that the default upgrade strategy should avoid upgrading anything which was already installed | 16:48 |
| clarkb | fungi: unless it is outside of the valid ranges iirc | 16:49 |
| clarkb | if you are within the valid ranges then pip should leave it alone | 16:49 |
| fungi | right, and in this case it is in the valid range | 16:49 |
| fungi | phase 1 installed oslo.config===8.0.2, phase 2 installs oslo.config>=6.1.0 which should already be satisfied but for whatever reason is not | 16:50 |
| *** rcernin has joined #openstack-infra | 16:50 | |
| *** sshnaidm has quit IRC | 16:55 | |
| *** rcernin has quit IRC | 16:59 | |
| *** jpena|off is now known as jpena | 17:04 | |
| *** markvoelker has joined #openstack-infra | 17:11 | |
| *** ykarel_ has joined #openstack-infra | 17:13 | |
| *** ykarel has quit IRC | 17:13 | |
| *** __ministry1 has joined #openstack-infra | 17:16 | |
| *** markvoelker has quit IRC | 17:16 | |
| *** __ministry1 has quit IRC | 17:16 | |
| *** ykarel__ has joined #openstack-infra | 17:17 | |
| *** jpena is now known as jpena|off | 17:17 | |
| *** ykarel__ is now known as ykarel|away | 17:19 | |
| *** ykarel_ has quit IRC | 17:19 | |
| *** auristor has quit IRC | 17:20 | |
| *** auristor has joined #openstack-infra | 17:21 | |
| *** ykarel_ has joined #openstack-infra | 17:22 | |
| *** ykarel|away has quit IRC | 17:24 | |
| *** Lucas_Gray has quit IRC | 17:26 | |
| *** dklyle has quit IRC | 17:32 | |
| *** dklyle has joined #openstack-infra | 17:33 | |
| *** yamamoto has joined #openstack-infra | 17:40 | |
| *** auristor has quit IRC | 17:43 | |
| *** yamamoto has quit IRC | 17:45 | |
| *** nightmare_unreal has quit IRC | 17:56 | |
| *** dciabrin has quit IRC | 17:57 | |
| *** dciabrin has joined #openstack-infra | 17:57 | |
| *** auristor has joined #openstack-infra | 18:02 | |
| *** pkopec has quit IRC | 18:06 | |
| *** tosky has joined #openstack-infra | 18:08 | |
| *** sshnaidm has joined #openstack-infra | 18:14 | |
| *** gyee has joined #openstack-infra | 18:17 | |
| smcginnis | fungi: Do you know where that "pip install --exists-action w" step happens? I don't see it in the main console output. | 18:17 |
| smcginnis | fungi: That does appear to be the cause of this. Something happened last Friday that changed this behavior. | 18:17 |
| *** hashar has joined #openstack-infra | 18:31 | |
| *** dklyle has quit IRC | 18:44 | |
| *** dciabrin has quit IRC | 18:52 | |
| *** dciabrin has joined #openstack-infra | 18:52 | |
| *** dklyle has joined #openstack-infra | 18:53 | |
| elod | smcginnis: I think that is not coming from zuul, rather from tox | 18:53 |
| elod | I guess that's a tox phase | 18:53 |
| smcginnis | Yeah, the log file created looks like it happens during the actual tox run (rather than the tox --notest phase). | 18:54 |
| smcginnis | So I thought maybe newer tox, but looking at the point where the cinder lower-constraints jobs started failing, the one that passed and the next that failed both used the same version of tox, so it doesn't look like it's tox directly at least. | 18:54 |
| *** lmiccini has quit IRC | 18:54 | |
| elod | I've tried to reproduce it with latest tox + pip but no luck yet :/ | 18:55 |
| *** rledisez has quit IRC | 18:59 | |
| *** rledisez has joined #openstack-infra | 19:04 | |
| *** slaweq has quit IRC | 19:08 | |
| *** ykarel_ is now known as ykarel|away | 19:08 | |
| *** dklyle has quit IRC | 19:16 | |
| *** dklyle has joined #openstack-infra | 19:16 | |
| *** KeithMnemonic has joined #openstack-infra | 19:21 | |
| *** ykarel_ has joined #openstack-infra | 19:22 | |
| *** ykarel|away has quit IRC | 19:24 | |
| *** ykarel_ has quit IRC | 19:50 | |
| fungi | newest tox release was 6 days ago, so unlikely to be the trigger | 19:58 |
| fungi | oh, wait, you said this seemed to crop up 5 days ago | 19:58 |
| fungi | so that could be it | 19:59 |
| fungi | though the changelog doesn't really have anything which jumps out at me | 20:00 |
| *** redrobot has quit IRC | 20:01 | |
| *** aedc has joined #openstack-infra | 20:16 | |
| *** hashar has quit IRC | 20:23 | |
| *** slaweq has joined #openstack-infra | 20:25 | |
| smcginnis | elod, fungi: Might be somehow related to the actual lower-constraints. The line output there may just be misleading. | 20:29 |
| smcginnis | I put up patches for cinder and nova earlier, and they both appear to make the lower-constraints job happy. | 20:29 |
| smcginnis | https://review.opendev.org/#/q/topic:lower-constraints+status:open+(project:openstack/cinder+OR+project:openstack/nova) | 20:29 |
| *** eharney has quit IRC | 20:30 | |
| clarkb | smcginnis: meaning that the instal without the constraints file is fixing things for us? | 20:30 |
| fungi | smcginnis: well, except we're also seeing it with upper constraints | 20:30 |
| fungi | basically constraints not applied in second phase (lower, upper, doesn't matter) | 20:31 |
| smcginnis | clarkb: I need to look closer. | 20:31 |
| *** Lucas_Gray has joined #openstack-infra | 20:31 | |
| smcginnis | Might just be that these get around the reasons it thinks it needs to upgrade the versions that are already installed from "tox -e lower-constraints --notest" | 20:31 |
| fungi | it's probably less noticeable with upper constraints in master because they're almost the same as unconstrained, but it's quite evident in stable branches | 20:31 |
| smcginnis | Ah, yep. I haven't looked at stable at all. | 20:32 |
| smcginnis | I took a look at the tox source, and I don't see how those constraints get passed in. | 20:32 |
| fungi | check the tox.ini | 20:32 |
| smcginnis | There's a dependency resolving step, but it wasn't immediately obvious where it checks constraints. | 20:33 |
| smcginnis | fungi: What about the tox.ini? | 20:33 |
| fungi | we generally set -c in the deps parameter, that's how it's getting passed to pip | 20:33 |
| smcginnis | Yeah, both of these are doing that. | 20:33 |
| fungi | oh, i bet this gets ignored by the second phase because it's only doing pip install . and not using the deps | 20:34 |
| smcginnis | cmd: /home/zuul/src/opendev.org/openstack/nova/.tox/py36/bin/python -m pip install --exists-action w -e . | 20:36 |
| *** eharney has joined #openstack-infra | 20:48 | |
| *** rcernin has joined #openstack-infra | 20:56 | |
| *** rcernin has quit IRC | 21:01 | |
| *** eharney has quit IRC | 21:01 | |
| *** eharney has joined #openstack-infra | 21:03 | |
| clarkb | dansmith: hey I'm trying to catch up on things I've been behind on and the subunit partial file thing not working is bubbling up | 21:22 |
| clarkb | dansmith: any chance you have a link to the job that you expected to log that for you? I'll try to see what is wrong there | 21:22 |
| *** slaweq has quit IRC | 21:29 | |
| smcginnis | I could have sworn I saw something about that being fixed recently. (recent being some time in the last month or two) | 21:31 |
| clarkb | smcginnis: I pushed a change to add the collection of the files back in but dansmith found it wasn't working | 21:33 |
| clarkb | I think we dropped the functionality entirely in the zuulv3 transition | 21:33 |
| clarkb | but its useful for debugging timed out jobs and testr crashes | 21:33 |
| smcginnis | Oh, OK. This sounds like maybe something different than I was thinking of then. | 21:34 |
| clarkb | except now I can't find tht log /me looks harder | 21:35 |
| clarkb | eavesdrop ftw I think I found it | 21:36 |
| clarkb | https://zuul.opendev.org/t/openstack/build/87acf04afa5f4bec8618a3802978f714 | 21:36 |
| donnyd | ok, so OE is ready to be brought back online | 21:42 |
| donnyd | I think | 21:42 |
| donnyd | The good news is there shouldn't be anymore heat or power issues - they all seem to have been solved | 21:43 |
| donnyd | the bad news is there is 2K less power so I can spin up as much gear if I want to stay inside the window for the generator with some kind of predictability | 21:43 |
| donnyd | less gear means less jobs... hopefully those running the custom jobs will be happy to have OE back online | 21:45 |
| donnyd | not sure how many general purpose jobs I will be able to run on this equipment without real workload testing | 21:45 |
| donnyd | *I can't spin up as much* | 21:46 |
| donnyd | fungi: whenever you are around to rebuild the mirror - lmk - no rush | 21:46 |
| fungi | donnyd: yay! | 21:50 |
| fungi | but also... infra-root: ^ hopefully one of you is better placed to take care of that. forecast is making it look increasingly likely that i'll be otherwise occupied with flood cleanup for the rest of this week | 21:50 |
| *** dave-mccowan has quit IRC | 21:51 | |
| clarkb | I can probably get to it at some point. I'm tracking down that issue for dansmith now. I think I get it but running some local tests to be sure | 21:52 |
| donnyd | No worries fungi | 21:53 |
| donnyd | Stay safe down there. We are about to get some rain, and the possibility for a generator test | 21:53 |
| fungi | donnyd: hope things don't get rough where you are either! | 21:53 |
| donnyd | clarkb: i am around whenever you aren't slammed. If we don't get to it right away, i am in no big rush | 21:55 |
| openstackgerrit | Monty Taylor proposed zuul/zuul-jobs master: Add a job for publishing a site to netlify https://review.opendev.org/739047 | 21:56 |
| fungi | we're at least prepared. barring stray waterspouts coming ashore, we just have to expect strong south winds and a few feet of water in the downstairs. but the last time this the entire neighborhood was left blanketed in a layer of dead seagrass a foot or more thick | 21:56 |
| fungi | cleaning and piling that up is backbreaking work i'm so not looking forward to | 21:57 |
| donnyd | Oh boy. Well we will be hoping for the best for you fungi | 21:57 |
| fungi | thanks! just glad i didn't get around to having the dock repaired after the last flood tore it apart | 21:58 |
| donnyd | If you were closer i would bring my kubota and clean that right up for you | 21:59 |
| *** tkajinam has joined #openstack-infra | 21:59 | |
| fungi | heh. actually the house next to us is owned by a guy who runs a landscaping company, so i may just pay him to have a crew clear our yard this time when they're done with his | 22:00 |
| *** yamamoto has joined #openstack-infra | 22:01 | |
| fungi | though i have some sapling mimosas i need to clear around by hand first and flag so they don't get driven over | 22:01 |
| donnyd | Well i hope it doesn't come to all that for you | 22:02 |
| fungi | me too, me too. but when the eye of a tropical cyclone passes immediately west of us, we're pretty much guaranteed to see wind-driven flooding | 22:04 |
| *** ociuhandu has joined #openstack-infra | 22:05 | |
| fungi | south winds pile water up in the sound, then southwest winds drive it right up into my neighborhood | 22:05 |
| clarkb | donnyd: ya lets see where I end up on this other thing. About to push a patch once local linter check apsses | 22:06 |
| *** ociuhandu_ has quit IRC | 22:07 | |
| *** eharney has quit IRC | 22:08 | |
| donnyd | clarkb: about to hit up some food and then will have to see what the wife has planned for the evening | 22:09 |
| donnyd | Everything should still be in place | 22:10 |
| openstackgerrit | Clark Boylan proposed zuul/zuul-jobs master: Fix partial subunit stream logging https://review.opendev.org/744565 | 22:12 |
| clarkb | dansmith: remote: https://review.opendev.org/744565 Fix partial subunit stream logging | 22:12 |
| clarkb | donnyd: ok I'm running up against the end of my day as well and needing to get a few things done. Maybe ianw is able to do that or we can pick it up tomorrow | 22:13 |
| ianw | clarkb: an OE mirror is what we're referring to? | 22:13 |
| *** bdodd has quit IRC | 22:14 | |
| clarkb | ianw: ya, its no big deal if you're busy. I can likely make time for it tomorrow | 22:14 |
| ianw | all the credentials, etc are the same? | 22:16 |
| fungi | ianw: correct. basically the most expedient solution to getting oe back online involved a wipe of the instances | 22:16 |
| fungi | afaik our tenant and flavors are still present | 22:16 |
| fungi | may need to upload a new image? not sure | 22:17 |
| ianw | ok, can take a poke soon | 22:17 |
| fungi | also conjecture, i haven't confirmed by testing | 22:17 |
| *** yamamoto has quit IRC | 22:25 | |
| *** bauzas has quit IRC | 22:32 | |
| *** bauzas has joined #openstack-infra | 22:37 | |
| openstackgerrit | Clark Boylan proposed zuul/zuul-jobs master: Fix partial subunit stream logging https://review.opendev.org/744565 | 22:52 |
| donnyd | Yea everything else is still intact | 23:05 |
| donnyd | Just need the mirror rebuild and we will have to update the dns records | 23:06 |
| *** tosky has quit IRC | 23:11 | |
| *** rcernin has joined #openstack-infra | 23:12 | |
| *** smarcet has joined #openstack-infra | 23:12 | |
| *** smarcet has left #openstack-infra | 23:13 | |
| *** bdodd has joined #openstack-infra | 23:14 | |
| *** Lucas_Gray has quit IRC | 23:14 | |
| *** rcernin has quit IRC | 23:15 | |
| *** rcernin has joined #openstack-infra | 23:16 | |
| *** Lucas_Gray has joined #openstack-infra | 23:19 | |
| *** adriant has joined #openstack-infra | 23:36 | |
| *** adriant has quit IRC | 23:36 | |
| *** adriant has joined #openstack-infra | 23:40 | |
| *** dchen has joined #openstack-infra | 23:40 | |
| *** dchen has quit IRC | 23:42 | |
| *** tetsuro has joined #openstack-infra | 23:43 | |
| *** dchen has joined #openstack-infra | 23:44 | |
| *** hamalq has quit IRC | 23:50 | |
| *** armax has quit IRC | 23:51 | |
| *** armax has joined #openstack-infra | 23:55 | |
| *** yamamoto has joined #openstack-infra | 23:59 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!