Is it big deal to use some icons borrowed from other app in the App Store?

Icons are definitely not freely copy-able. Apps in the App Store still enjoy the copyright protections afforded under intellectual property laws in your region.

If you've found an app with icons that you're smitten with try contacting the developer about it. Often developers will purchase icon sets from icon factories like iconarchive.com (link omitted on purpose). These icon sets are licensed to you, for use in your applications, and come with the necessary license to allow you to redistribute and profit off any product that includes them. You can find free and paid-for icon sets out there. The developer might be forthcoming if they purchased their icons from a factory.

If the developer has designed the icons on their own they may choose to license them to you or they may say no. In which case: respect their wishes or you may find yourself on the receiving end of a cease-and-desist letter that prevents you from selling or giving away your app to the masses.