"Yeah. I mean, they're big enough to eat sharks and dolphins and sea folk, so they're definitely big."

Humans were safe from orcas because humans were land animals, and not part of the potential typical diet for the species. Sea monsters (or sea folk as he's been referring to himself lately) are technically more fish than anything, and don't have that advantage.