"Kevin..." makes solid and relevant observations.
Add to those;
Browsers handle these 'secure' connections (and the 'Certificates' associated with them) as a "Trust on First Use" approach, by default.
This means we trust the computer to be configured to look up Certificate Revocations with each use; trust that the Certificate is valid; trust that no one has interjected themselves into the data stream; trust that the ISP being used has unblemished employees, and so on.
Even the Trust Model of Certificate Authorities & the protocols involved has become questionable because of lax issuance of Certificates and outright hacking of Certificate Authorities and subsequent issuance of fraudulent certificates.
(Comodo, RSA & DigiNotar for example)
All that on top of the assumption that your computer does not have malware that intercepts keystrokes before it even gets launched from the browser.
For all but the most adept in Security, it gets down to a matter of trust across the entire fabric of the Internet...and the less you know, the more you must rely on 'trust'.
The lure of the convenience aspect often overwhelms the phobia inherent to using a convoluted and abstract technical system which for the most part is indistinguishable from magic.