After some discussion with patrik on IRC, we figure out this is a problem on avatar merge, patrick suggest a change on src/syncevo/configs/scripting/05vcard-merge.xml to fix it.