I got my buttons working in ReplyKeyboardMarkup and i changed it into InlineKeyboardMarkup with the following code

mark_up = InlineKeyboardMarkup(
    [[InlineKeyboardButton('inline button')]]
)

And i get the following error

telegram.error.NetworkError: Error : 400 : Bad Request: Can't parse inline keyboard button: Text buttons are unallowed in the inline keyboard

Below is the documentation of the InlineKeyboardMarkup and as you can see it is refering to a list of InlineKeyboardMarkup and not InlineKeyboardButton.

"""This object represents a Telegram InlineKeyboardMarkup.
Attributes:
inline_keyboard (List[List[:class:telegram.InlineKeyboardMarkup]]):
Args:
inline_keyboard (List[List[:class:telegram.InlineKeyboardMarkup]]):
"""