Opened 5 years ago

Closed 5 years ago

#2367 closed task (fixed)

Dronie agents are out of space

Reported by: strk Owned by: sac@…
Priority: critical Milestone: Sysadmin Contract 2019-II
Component: SysAdmin Keywords:
Cc:

Description

As per disk quota exceeded error message, see https://dronie.osgeo.org/postgis/postgis/736

Change History (7)

comment:1 by strk, 5 years ago

The https://wiki.osgeo.org/wiki/Dronie page give instructions to spot known agents by reading /var/log/drone.log* but no such file exists either in container or host server

comment:2 by strk, 5 years ago

Just a guess, we could be having agents suffering from lack of garbage-collection in docker engine: https://git.osgeo.org/gitea/sac/drone-agent-config/issues/3

comment:3 by strk, 5 years ago

Build 740 for postgis/postgis had this problem too (in case it's possible to tell which agent took which build).

comment:4 by strk, 5 years ago

If I got it right I can see the failing jobs 740 are running with agent stage_machine = @h.pcorp.us

comment:5 by robe, 5 years ago

oh that's my fault. Okay let me shut that one off. didn't know I still had it on.

comment:6 by robe, 5 years ago

I've turned that one off now and rerunning the above filaed job. Though it df -H showed it had around 250 GB space. So maybe its some docker partition thing not set right on it.

comment:7 by robe, 5 years ago

Resolution: fixed
Status: newclosed

I've shut this agent off so closing.

Note: See TracTickets for help on using tickets.