I'm hoping you can tell me what this blue flowering plant is as well:

The first one looks like some sort of ginger. At least the leaves are very ginger-looking and they do grow from a rhizome.

Kevin

You are absolutely right Ken, thank you for your help!

It is a ginger, Hedychium coronarium, to be exact.

Any idea on the blue flowering plant?

Angelica

Blue looks like hardy plumbago, Ceratostigma plumbaginoides.

That's it! You guys rock! Thank you!