Do you want to delete a DB with the backup history? Easy (SQL Server)

Easy to do:

EXEC msdb.dbo.sp_delete_database_backuphistory @database_name = N'FIN63_JAP'
DROP DATABASE [FIN63_JAP]

Results:

Deletes the database including backup information.