Yep, you were right. I went outside and messed with it again after I posted and just happened to see the axle spinning but the rim was not. I said "dang..." and then went to hunt the key where I took the rim off. Luckily I found it and it works!
Next, I have had much trouble getting the right...