Neighbors to Represent their Neighborhoods