Tricky to explain without more context. It does imply a certain amount of doubt though...
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.
For your guidance, Longman Dictionary of Contemporary English for Advanced Learners says as follows:
you would have thought (that)
(also you would think (that)) used to say that you https://www.ldoceonline.com/jp/dictionary/expect something t