Andy, as a postmaster and guitarist, I feel I can easily take the middle ground here . . .
But first, let me get this straight - You don't want them to leave it . . . and you don't want to (can't) pick it up ???????????
. . . . and that means, they did What wrong??????? What option does that give them?
. . . okay, here's where I tell you what I'd do in my office . . . I understand that most of my customers (at least those who can afford LP's) work during our business hours . . . However, even when our lobby is closed, we have people working before & after, doing other postal related tasks (reloading weapons etc) . . . . So, I allow my customers to pick up packages earlier and later in the day, even when we're closed . . . I have someone here working at 7, even though we open at 9 . . . many of my customers can stop to pick up their stuff early on their way to work . . . same thing in the PM . . . we close at 5, but are here until 5:30 - that extra half hour does make a difference . . . . bring the PM a bottle of Grey Goose for additional accommodation . . . better yet, bring me a bottle of Grey Goose, and I'll call your PM for help . . .
Or, you can always call them and ask them to drop it off at a neighbors house . . . surely in your area there's some unemployed Amish folk hanging around the barn who could watch it . . .
. . . . of course, this is all moot, as I see you have the guitar now . . . congrats, she's a beauty!