Here is probably the easiest way:
Pour some distilled water in a bowl. Place the humidifier in the water with the exposed end in the water. You'll see bubbles as the foam absorbs the water. Once it stops absorbing water, you're good to go. Wipe down the outside so no distilled water drips all over your stash before placing it back in your humidor.