Bayfield and Bayfield County are nice places to visit when it's warm. The one thing that isn't ever very warm is the waters of Lake Superior and Chequamegon Bay. I don't think the water ever gets over 53-54 degrees.
I haven't been over to Madelein Is. but I did a trip out to the sea caves adjacent to Meyers Beach near Cornucopia. That on the west side of the Indian reservation. Meyers Beach faces out into the lake. There's no shelter so it's only doable when the weather is cooperative.
The kayak livery is in the town of Bayfield on the bayside. A nice little town but don't expect crowds. It's a little off the beaten path.
Oh, yeah, if you drive down County Highway C from Washburn to Cornucopia watch out for bears.

: Hi
: It looks like I will be in Milwaukee on business in July - I did a bit of
: googling and the Apostle Islands seem like the kind of place a fella
: should see before returning home across the Atlantic. Any hints or
: pointers from you guys - seems to be a few kayak companies in the area
: that do trips etc.
: Cheers
: Pat