Depois de andar aqui a partir pedra, encontrei isto:
// Remove links to the extra feeds (e.g. category feeds)
remove_action( 'wp_head', 'feed_links_extra', 3 );
// Remove links to the general feeds (e.g. posts and comments)
remove_action( 'wp_head', 'feed_links', 2 );
// Remove link to the RSD service endpoint, EditURI link
remove_action( 'wp_head', 'rsd_link' );
// Remove link to the Windows Live Writer manifest file
remove_action( 'wp_head', 'wlwmanifest_link' );
// Remove index link
remove_action( 'wp_head', 'index_rel_link' );
// Remove prev link
remove_action( 'wp_head', 'parent_post_rel_link', 10, 0 );
// Remove start link
remove_action( 'wp_head', 'start_post_rel_link', 10, 0 );
// Display relational links for adjacent posts
remove_action( 'wp_head', 'adjacent_posts_rel_link', 10, 0 );
// Remove XHTML generator showing WP version
remove_action( 'wp_head', 'wp_generator' );
e o a linha
// Remove links to the general feeds (e.g. posts and comments)
remove_action( 'wp_head', 'feed_links', 2 );
removeu-me as referências:
<link rel="alternate" type="application/rss+xml" title="Mané Teixeira » Feed" href="http://www.maneteixeira.com/feed/" />
<link rel="alternate" type="application/rss+xml" title="Mané Teixeira » Comments Feed" href="http://www.maneteixeira.com/comments/feed/" />
e coloquei antes do wp_head() a seguinte linha de código.
<link rel="alternate" type="application/rss+xml" title="<?php wp_title(); ?>" href="<?php bloginfo('rss2_url'); ?>" />
/>
Resolvendo assim o meu problema!
Não sei até que ponto isto será a melhor forma, mas foi a única maneira que consegui por isto a funcionar.