Aaron Taylor-Johnson always travels with his family and considers spending time with his wife and kids a "luxury".