An attempt to connect to an IPv6 host using the flag -o directport=<port> similar to:
/usr/bin/sshfs [2001:db8:1::3]:/path /mnt/path -o directport=41955 ...
will always fail.
The likely reason for this can be found in the connect_to function at sshfs.c line 1260 where the family is set to PF_INET. There's never an attempt to connect using PF_INET6.