I just don't fit in

So, today I honestly got really angry.  Like really really angry.   And so I just decided to stop and think.  And something that feels true to me is this.  I feel like I really don't fit in anywhere.  I guess I should explain.  I have grown up thinking that no one likes me.  Well, of course that is just not true.  So, I was wondering why I always feel alone when I am with groups.  Pretty much any type of group.  When I am with my LDS friends, I feel as though I can't be myself.  Mormons get offended really easily.  So I always try to keep my humor down.  And then with my non-member friends, I feel as though I am too goodie goodie for them to even want me around.  So I am stuck in the middle.  Where I need people who have the same values as me, but would be totally ok with me saying a few off color things and being myself.  And there are those friends that I can be myself around, and I love them dearly.  But the only problem now is, they are all gone away.  I am left alone here in Colorado.  So what am I supposed to do now?  I really don't like this feeling.  Why can't I just fit in?