Word for an activity that one does not care for?

I'm looking for a word or phrase to describe an activity which is not liked by everybody. You either like it or you don't. This word or phrase shouldn't be critical. I don't mean to say that somebody's interests don't make any sense. What I do mean is that I'm not someone who might be interested in this kind of activity, I'm not the right person to take it up.

For example:

Would you like to try canoeing? - Not really. It's ... (only for those who really like this kind of activity but I'm not one of them).


Would you like to try canoeing? - Not really. It's not to my taste/liking.
Would you like to try canoeing? - Not really. It's not right/just up/down my alley/street.

MW:

to someone's taste idiom
: liked by someone
The movie was not to their taste.

to someone's liking idiom
: appealing or enjoyable to someone
She reads poetry, but fiction is much more to her liking.

TFD(idioms):

right up your alley [mainly AMERICAN] If something is right up your alley, it is the kind of thing you like or know about.
This should be right up my alley but, despite the film's special effects, I found it rather boring.
Note: You can also say that something is right down your alley.
I'll need whatever information you can turn up within the week. This case seems right down your alley.
Note: The usual British expression is right up your street.

Collins COBUILD Idioms Dictionary, 3rd ed. © HarperCollins Publishers 2012


It's not everybody's/my/... cup of tea.

not (one's) cup of tea:

Not something one prefers, desires, enjoys, or cares about.

Thank you for the invitation, but long-distance cycling just isn't really my cup of tea.

When I found out that reading wasn't his cup of tea, I knew that there wasn't much of a relationship in store between us.

Farlex Dictionary of Idioms. © 2015 Farlex, Inc, all rights reserved.

.........

not one's cup of tea

Fig. not one's choice or preference. (Used to describe an activity you do not enjoy. Can sound somewhat affected.)

You three visit the museum without me. Looking at fussy old paintings is not my cup of tea.

Going to church, Mary said, was not her cup of tea.

McGraw-Hill Dictionary of American Idioms and Phrasal Verbs. © 2002 by The McGraw-Hill Companies, Inc.

The more general statement not everybody's cup of tea is also idiomatic; it appears as a title in this article in the Economist (on voting reform in the UK). As one might expect, there is more of a 'British English' flavour. But as this thread shows, it is not uncommon in the United States.


You could simply say not my kind of thing:

somebody’s kind of person/thing/place etc

the type of person, thing, place etc that someone usually likes

Your example:

— Would you like to try canoeing?
— Not really. It's not my kind of thing.


Another good and very common expression would be not one's bag:

To not be something one prefers, desires, enjoys, or cares about.

Example:

Thank you for the invitation, but long-distance cycling just isn't really my bag.


You could say [it / canoeing] is not for me, according to Longman Dictionary of Contemporary English:

something is not for somebody: used to say that something is not the kind of thing that someone likes or will enjoy

In your example:

Would you like to try canoeing? - Not really. It's not for me.

Or alternatively:

Would you like to try canoeing? - No, canoeing is not really for me.

Attribution: "Something Is Not for Somebody." Something Is Not for Somebody | Meaning of Something Is Not for Somebody in Longman Dictionary of Contemporary English | LDOCE. Accessed April 09, 2018. https://www.ldoceonline.com/dictionary/something-is-not-for-somebody.


For canoeing specifically:

Q) Would you like to try canoeing?

A) No thanks, canoeing doesn't float my boat