I could be wrong but I do not think so as this would be N:1 relationship meaning one contact can be associated with many accounts in this scenario..
since look up field allow you to select only one record, if you want to achieve this functionality then may be create N:N relationship (or use existing feature like connections to connect two entities based on role)