Friday, 2021-07-30

« Thursday, 2021-07-29 Index Saturday, 2021-07-31 »
*** ykarel|away is now known as ykarel04:33
*** marios is now known as marios|ruck05:05
pojadhavmarios|ruck, fyi soniya is on PTO today.05:52
marios|ruckpojadhav: thanks05:55
*** amoralej|off is now known as amoralej06:39
zbrmarios|ruck: i am afraid that there were some design mistakes when get_hash module was written07:27
zbrfor example assumption that pyyaml and requests are installed, that is only true for controller, not other hosts, and modules run everywhere.07:27
zbrrequests can be avoided as python urllib does a good job07:28
zbrbut yaml not really, especially as it is a tricky library to install. still, pythn has native json support07:28
marios|ruckzbr: so you want to switch yaml to json config? 07:29
zbri  have no wishes, only stating what i found so far.07:29
marios|ruckzbr: k 07:29
marios|ruckzbr: how is the 'wire it up' going? i didn't check for a few days07:29
zbri find json editing by hand not a real pleasure.07:30
zbrbut we could have both, when run remotely it would use embedded config, we could make that one json while still supporting external yaml ones when module is present.07:31
zbri did not had any progress on wiring bits because i failed to merge the "enable sanity" change. i would go for wiring as soon i manage to activate sanity jobs (even if they are non-voting and failing)07:32
zbris not that I do not want to do wiring, but sanity reports problems like the one above, which I would clearly hit when trying to do the wiring 07:32
zbrmarkes sense?07:32
marios|ruckzbr: ack 07:33
*** ykarel is now known as ykarel|lunch08:25
*** amoralej` is now known as amoralej08:58
zbrmarios|ruck: chandankumar: can you please check https://review.opendev.org/c/openstack/tripleo-repos/+/800462 -- sanity failure is on purpose (to reduce change size)09:32
zbras sanity check reports a huge number of problems, i only fixed some, and i will fix the rest in two follow-ups.09:32
marios|ruckzbr: sure in a bit middle something now09:34
akahatmarios|ruck, hey.. i'm updating hash_count for non-master releases.09:34
marios|ruckakahat: great thank you 09:35
chandankumarmarios|ruck: sure09:52
*** ykarel|lunch is now known as ykarel09:52
marios|ruckchandankumar: o/ review request was from sorin 09:58
* marios|ruck going to pickup kiddo from school biab11:10
marios|ruckif anyone asks for the ruck tell them he moved to antarctica11:10
dviroelhi @team, please add this one to your reviews list: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3461211:29
*** rlandy is now known as rlandy|ruck11:55
rlandy|ruckmarios|ruck: hi ...11:59
rlandy|ruckhow goe sit?12:00
rlandy|ruckI was looking into the cockpit number of gate failure explosion 12:00
rlandy|ruck209 :)12:00
rlandy|rucknot representative12:00
rlandy|rucksoniya out?12:01
rlandy|ruckpojadhav: sorry of delay - your patch are on my review list today12:01
marios|rucko/ rlandy|ruck 12:02
marios|ruckrlandy|ruck: yeah gate numbers are way off i couldn't find any recent commits that would have messed it up though 12:02
marios|ruckrlandy|ruck: 08:52 < pojadhav> marios|ruck, fyi soniya is on PTO today.12:02
marios|ruckrlandy|ruck: nothing major today but of course new gate blocker \o/ https://bugs.launchpad.net/tripleo/+bug/1938539 12:03
rlandy|ruckmarios|ruck: yeah me neither ...12:03
marios|ruckrlandy|ruck: should appear on cix soon and rabi is already digging there 12:03
rlandy|ruckk12:03
rlandy|ruckwrt gate numbers12:03
rlandy|ruckit looks like it's counting canceled jobs12:04
rlandy|ruckbut idk why12:04
rlandy|ruckso if the queue gets reset12:04
rlandy|ruckit counts all the jobs restarted12:04
marios|ruckrlandy|ruck: i cannot understand how that would have changed 'externally' i mean if we didn't merge any changes there12:04
rlandy|ruckcorrect12:04
rlandy|ruckunless zuul changed the status of canceled jobs12:04
rlandy|ruckwill look more later if I have time12:05
zbrhttps://review.opendev.org/c/openstack/ansible-role-collect-logs/+/792652/ is also ready, let me know if there is something unclear in it.12:06
marios|ruckrlandy|ruck: don't know just did some more digging... wasn't it reporting 'outside' jobs like non tripleo projects i mean, last week too? and after restart was OK ? 12:11
* marios|ruck checks notes12:11
marios|ruckrlandy|ruck: cant find any announcements about zuul upgrade etc ususally they send such things 12:11
rlandy|ruckyep - before the wrong jobs12:11
rlandy|ruckwe can try a restart12:12
rlandy|ruckmay data overflow :)12:12
chandankumarrlandy|ruck: https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/249908 will be needed for downstream as https://review.opendev.org/c/openstack/tripleo-quickstart/+/790701 got merged12:16
rlandy|ruckchandankumar: thanks - merging12:19
chandankumarrlandy|ruck: https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/260558 one shell var missed12:27
rlandy|ruckchandankumar: k - merged12:28
*** amoralej is now known as amoralej|lunch12:45
chandankumarrlandy|ruck: sorry one more typo https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/26057012:54
rlandy|ruckk - done12:59
chandankumarrlandy|ruck: things are working now https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/status#26055613:16
chandankumarrlandy|ruck: last patch left for tripleo-operator-ansible https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/79092613:17
zbrchandankumar: rlandy|ruck: please re +W https://review.opendev.org/c/openstack/tripleo-ansible/+/787767 13:18
marios|ruckrlandy|ruck: fyi glance component master https://bugs.launchpad.net/tripleo/+bug/1938558 13:19
rlandy|rucknice13:21
marios|ruckrlandy|ruck: yah lavly13:21
rlandy|ruckThe server has either erred or is incapable of performing the requested operation13:22
rlandy|ruckeither?13:22
marios|ruckrlandy|ruck: yeah digging a bit more to see if i can find errors in glance etc will update if find something 13:22
marios|ruckrlandy|ruck: but am seeing delays again with cix cards showing up .. that one and another i filed earlier still missing (https://bugs.launchpad.net/tripleo/+bug/1938558 https://bugs.launchpad.net/tripleo/+bug/193853913:23
* rlandy|ruck looks13:23
rlandy|ruckI don;t see them yet13:24
rlandy|ruckwill keep a check on that13:24
marios|ruckrlandy|ruck: ack13:24
rlandy|ruckwe can manually create them if needed13:24
rlandy|ruckfrom triple infra doc13:24
pojadhavrlandy|ruck, sure np :)13:25
rlandy|ruckpojadhav: hey - could you restart the cockpit?13:27
rlandy|ruckgate numbers are off again13:27
rlandy|ruckI think that was the issue last time13:27
pojadhavrlandy|ruck, i dont have access to production cockpit :(13:27
rlandy|ruckmarios|ruck: ^^13:27
* rlandy|ruck checks if I do13:27
marios|ruckrlandy|ruck: 209 fails https://www.dailydot.com/wp-content/uploads/693/44/f74bf8fba3ce40739c1425f3488cce7c.jpg 13:28
marios|ruckrlandy|ruck: i can check too gimme sec digging at glance logs13:28
rlandy|ruckyou can't believe everything you read these days13:28
rlandy|ruckhttp://tripleo-cockpit.usersys.redhat.com/d/9DmvErfZz/cockpit?orgId=113:29
rlandy|ruckthat one may be more accurate13:29
marios|ruckrlandy|ruck: :) 13:30
rlandy|ruckcan't reach the internal copy13:30
rlandy|ruckidk what server that is even13:31
rlandy|ruckpojadhav: do you know which server is production?13:31
rlandy|ruckip address?13:31
pojadhavrlandy|ruck, idk ip address13:32
rlandy|rucknvm13:32
rlandy|ruckI am in to some server13:32
marios|ruckrlandy|ruck: pojadhav: what user do we have for the cockpit any ideas? managed to login with my name13:33
rlandy|ruckyeah - I am in the same place13:33
pojadhavadmin13:33
rlandy|rucklogged in13:33
marios|ruckah rlandy|ruck i see you aer in there too 13:33
chandankumarrlandy|ruck: since all patches are merged now, can you rekick the rhos-16 and 17 line?13:33
rlandy|rucksu- admin13:33
marios|ruckrlandy|ruck: yah see you with 'who'13:33
rlandy|ruckno user13:33
marios|ruckrlandy|ruck: heh just tried same 13:33
rlandy|ruckmarios|ruck I am there as root13:33
rlandy|ruckno tmux sessions13:34
marios|ruckrlandy|ruck: :) we are literally typing the same stuff now 13:34
rlandy|ruckpojadhav: we logged into cockpit-ci.tripleo.org13:34
rlandy|ruckmarios|ruck: great minds think alike13:34
pojadhavokay13:34
rlandy|ruckor the blind leading the blind here13:34
rlandy|ruckpojadhav: there is no admin user13:35
rlandy|ruck[root@rrcockpit ~]# su - admin13:35
rlandy|rucksu: user admin does not exist13:35
pojadhavin th UI of production server always used admin user only.. and inside server i use centos user13:35
pojadhavswitch to centos13:36
rlandy|ruckmarios|ruck: ^^ su - centos13:36
rlandy|ruckjoin the tmux13:36
marios|ruckrlandy|ruck: yeah doing13:36
marios|ruckpojadhav: are you able to login to this and join us to restart please i think you've done this more recntly that me and rlandy|ruck 13:37
marios|ruckpojadhav: sending you pvt with the ip addres now13:37
pojadhavi never restarted cockpit13:37
pojadhavwe and sagi do always :)13:38
marios|ruckpojadhav: ah ok 13:38
marios|ruck:/13:38
marios|ruckpojadhav: thanks np, we should probably have this documented rlandy|ruck :)13:38
rlandy|ruckmarios|ruck: gm?13:38
marios|ruckrlandy|ruck: sure13:38
rlandy|ruckso we stop typing the same things one after the other13:38
marios|ruckrlandy|ruck: https://meet.google.com/whn-grqz-qrq13:39
marios|ruckanyone around that has worked with cockpit recently? chandankumar maybe ? 13:39
*** amoralej|lunch is now known as amoralej13:43
marios|ruck                     i filed earlier still missing (https://bugs.launchpad.net/tripleo/+bug/1938558 13:52
marios|ruck                     https://bugs.launchpad.net/tripleo/+bug/193853913:52
marios|ruckrlandy|ruck: ^^^ 13:52
chandankumarmarios|ruck: nope14:01
marios|ruckchandankumar: ack thanks 14:01
-opendevstatus- NOTICE: There will be a brief outage of the Gerrit service on review.opendev.org starting at 15:00 UTC today as part of a routine project rename maintenance: http://lists.opendev.org/pipermail/service-announce/2021-July/000023.html14:10
-opendevstatus- NOTICE: There will be a brief outage of the Gerrit service on review.opendev.org in the next few minutes as part of a routine project rename maintenance: http://lists.opendev.org/pipermail/service-announce/2021-July/000023.html14:59
rlandy|ruckmarios|ruck: I don't see any new CIX cards yet15:13
rlandy|ruckcloned tripleo-critical-bugs15:14
marios|ruckrlandy|ruck: thanks15:14
rlandy|rucknot sure about the config list15:17
rlandy|ruckmarios|ruck: k - here goes - trying the script w/o reporting hopefully15:34
marios|ruckrlandy|ruck: w/o reporting? 15:40
rlandy|rucki want to check what it will do first:)15:42
rlandy|ruckbefore I hose anything15:43
marios|ruckrlandy|ruck: ack i mean it *is* friday so what could possibly go wrong, but fair enough play i safe :D15:43
marios|ruckrlandy|ruck: plus I'm leaving in a few mins so you should take no advice from me 15:43
rlandy|ruckit's running I guess 15:44
rlandy|rucknothing so far15:44
rlandy|ruckI mean I'd expect to see output15:45
marios|ruckrlandy|ruck: :/ dont know never seen or ran that script before 15:45
rlandy|ruckmarios|ruck: nobody alive with the exception of wes has run that script15:46
rlandy|rucksmall step for (wo)man, giant leap ...15:46
marios|ruckrlandy|ruck: :) we really should import it into the ci-config repo or wherever15:46
rlandy|ruck well it reported a whole lot of bugs15:47
rlandy|ruckcritical bugs not tracked on board []15:47
marios|ruckrlandy|ruck: still no new cix cards though 15:47
rlandy|ruckso clearly we need some settings adjustments15:47
rlandy|ruckopenbugs {1918597, 1918476, 1895822, 1909008, 1927952, 1915921, 1934875, 1936285, 1934880, 1936420, 1908005, 1937333, 1933115, 1888700, 1900357, 1916742, 1909574, 1910217, 1906769, 1931601, 1937236, 1935834, 1904223, 1889122, 1914600, 1915242, 1922032, 1914229, 1908982, 1921400, 1921401, 1923194, 1931516, 1918333}15:47
rlandy|ruckmatch {1918597, 1918476, 1895822, 1927952, 1909008, 1915921, 1934875, 1936285, 1934880, 1936420, 1908005, 1937333, 1933115, 1888700, 1900357, 1909574, 1916742, 1910217, 1906769, 1931601, 1937236, 1935834, 1904223, 1889122, 1914600, 1915242, 1922032, 1914229, 1908982, 1921400, 1921401, 1923194, 1931516, 1918333}15:47
marios|ruckrlandy|ruck: the ones in 'match' are on the board but one i checked is in done15:48
marios|ruckrlandy|ruck: oh there is an openbugs didn't notice that one 15:48
marios|ruckrlandy|ruck: the ones we want aren't in this list15:49
rlandy|ruckone sec15:49
rlandy|rucklet ,e try this again15:49
marios|ruckrlandy|ruck: tripleo/+bug/1938558 tripleo/+bug/193853915:49
rlandy|ruck[LaunchpadBugs]15:49
rlandy|ruckTripleO=tripleo,.*15:49
rlandy|ruck^^ right?15:50
marios|ruckrlandy|ruck: sure i mean 'tripleo' is the launchpad project15:50
rlandy|ruckcritical bugs not tracked on board []15:50
marios|ruckdon't know what .* means in that context though? 15:50
rlandy|ruck^^ that is wrong15:50
marios|ruckrlandy|ruck: pretty sure i marked them critical checking15:51
marios|ruckrlandy|ruck: yup 15:51
marios|ruckrlandy|ruck: https://bugs.launchpad.net/tripleo/+bug/1938558 https://bugs.launchpad.net/tripleo/+bug/1938539 15:51
rlandy|ruckmarios|ruck: diff between xena-3 and rc-1?15:52
rlandy|rucknvm https://bugs.launchpad.net/tripleo/+bug/1936825 is xena-315:52
marios|ruckrlandy|ruck: well xena-3 is our current active15:52
marios|ruckrlandy|ruck: but they are both xena315:52
* rlandy|ruck shares15:53
rlandy|ruckpls check me15:53
marios|ruckrlandy|ruck: rc1 should be valid but that comes after 15:53
rlandy|ruckmarios|ruck: 5 mins pls ... https://meet.google.com/gjc-psvh-yew?pli=1&authuser=015:53
marios|ruckrlandy|ruck: ack sec 15:53
*** amoralej is now known as amoralej|off16:05
marios|ruckrlandy|ruck: off in a sec 16:27
rlandy|ruckmarios|ruck: have a good weekend!16:28
rlandy|ruckyou deserve it!!16:28
marios|ruckrlandy|ruck: u 2 16:28
marios|ruckrlandy|ruck: u 2 :D16:28
*** marios|ruck is now known as marios|out16:30
* dviroel start closing hundred of tabs21:10
dviroeladding new molecule job for compose-promoter: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3476721:13
dviroelrlandy|ruck: if you are still around ^, just to let you know :)21:14
dviroeljob is passing, still need do add some checks in verify21:14
dviroelhave good weekend21:15
rlandy|ruckdviroel: nice21:15
rlandy|ruckhave a good weekend21:15
dviroelwe can continue on monday21:15
dviroelrlandy|ruck: thanks21:15
rlandy|rucklet's merge and get config going on monday21:16
dviroelack21:16
« Thursday, 2021-07-29 Index Saturday, 2021-07-31 »

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!