vlans or not, it will generally not work as you seem to expect to have
two interfaces in the same subnet. pf and route-to might be enough to
make it work, but you should probably just configure the different
addresses on one interface.

Or, maybe I'm completely mistaken, but judging from only a dmesg it is
rather hard to tell what you're trying to accomplish. You should include
at least ifconfig output and hostname.* files, probably also the pf
rules you mention.

Jussi Peltola