yes this also happened on me, i built a cellar few tiles from the village border and villagers dumped some food items there including 2 bags of grain. When i took it back to my real base the game register it (taken) and it tainted everything that the flour touches as (taken) as well, like the other bag that i grinded the grains in, wooden bowl, and pot. When I returned to that village, the villagers yell at me for not paying my debt, and even included all those tainted items that originally belonged to me. Funnily enough i just needed to say I can't pay and they let me off