I would use it, but it's not available in Canada at the moment (different banking laws mean they have to roll out different sites for different countries).
I totally see where you're coming from but I'm convinced that mint is 100% safe. It's very widely used, and by nature it's widely used by very meticulous and suspicious people. I haven't heard of a single case of even accused wrong doing or privacy violations.
It also was bought by Intuit recently. This pretty much means two things;
1.) It's safe. People have been trusting Intuit with their monetary records and bank account info since the dawn of online banking services.
2.) It may be monetized as some time.
Intuit has has criticisms levelled against them, but as far as I know, they all deal with their anti-competitive business strategy and lobbying to monetize services that would otherwise be free.
Either way, yes, I trust mint.com