As a minimum you will also need a twitter:card meta tag included, so that Twitter knows what type of card to render. Other than that, the og: tags should be picked up and used, but you will need to make sure that all of the required tags are present (so e.g. a Summary card requires a description, whether that is in twitter: or og: format).