Bug 1094658 - Sometimes a build finishes but gets stuck in 'Running' state
Summary: Sometimes a build finishes but gets stuck in 'Running' state
Keywords:
Status: CLOSED CANTFIX
Alias: None
Product: Copr
Classification: Community
Component: frontend
Version: unspecified
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
Assignee: Miroslav Suchý
QA Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2014-05-06 09:01 UTC by Daniel Vrátil
Modified: 2015-11-02 01:37 UTC (History)
2 users (show)

Fixed In Version:
Clone Of:
Environment:
Last Closed: 2014-10-15 12:43:53 UTC
Embargoed:


Attachments (Terms of Use)
Screenshot from Copr (18.28 KB, image/png)
2014-05-06 09:01 UTC, Daniel Vrátil
no flags Details

Description Daniel Vrátil 2014-05-06 09:01:28 UTC
Created attachment 892813 [details]
Screenshot from Copr

Description of problem:
It happened to me a few times, that build on all archs have finished, logs and rpms were downloaded from builders, the Copr web is showing correct "Ended on" time, but the build remained in 'Running' state.

Example is build 11629 in http://copr.fedoraproject.org/coprs/dvratil/kde-frameworks/, which is still shown as Running in the interface. Previously, with some other build, the build has turned to Failed after more than 24 hours (but maybe Copr was restarted over night).

This obviously breaks any automation tools that are waiting for the build to finish :-)


From mockchain.log:
http://pub.progdan.cz/kf5/srpm/4.99.0/kf5-kcoreaddons-4.99.0-2.fc20.src.rpm

starting logfile: None
results dir: /var/tmp/mockremote-YZqWi/build/results/fedora-rawhide-x86_64
config dir: /var/tmp/mockremote-YZqWi/build/configs/fedora-rawhide-x86_64
Fetching http://pub.progdan.cz/kf5/srpm/4.99.0/kf5-kcoreaddons-4.99.0-2.fc20.src.rpm
Start build: /tmp/tmpJHPPpV/kf5-kcoreaddons-4.99.0-2.fc20.src.rpm
building kf5-kcoreaddons-4.99.0-2.fc20.src.rpm
End build: /tmp/tmpJHPPpV/kf5-kcoreaddons-4.99.0-2.fc20.src.rpm
Success building kf5-kcoreaddons-4.99.0-2.fc20.src.rpm
Results out to: /var/tmp/mockremote-YZqWi/build/results/fedora-rawhide-x86_64
Pkgs built: 1
Packages successfully built in this order:
/tmp/tmpJHPPpV/kf5-kcoreaddons-4.99.0-2.fc20.src.rpm

Comment 1 Miroslav Suchý 2014-05-06 11:21:47 UTC
Hmm this may happen when underlying Open Stack VM crash (happen for various reason). I thought that we have in place check which rerun "Running" task if they are older then several hours.
I will check that.

Comment 2 sensor.wen 2014-10-14 15:46:08 UTC
I also encountered this problem. It did not stop, and can not be canceled.

URL: https://copr.fedoraproject.org/coprs/mosquito/myrepo-testing/build/52886/

Comment 3 sensor.wen 2014-10-14 15:58:03 UTC
My God, waited two hours, and finally completed. On my computer, the compiler takes only one minute.

Comment 4 Miroslav Suchý 2014-10-15 12:43:53 UTC
Again, it was OpenStack issues during night. When all spawned VM went directly into Error state and Copr was trying spinning new and new VM. So technically this state was correst. It was starting, but never got beyond that point.

Hopefully this will be resolved by new OpenStack installation.

I'm going to close this bug as there is nothing we can do in Copr code. This is infrastructure and needs to be reported to Fedora Infra. Best method is #fedora-buildsys or #fedora-admin on Freenode.


Note You need to log in before you can comment on or make changes to this bug.