Joining pandas dataframes by column names
I have two dataframes with the following column names:
frame_1:
event_id, date, time, county_ID
frame_2:
countyid, state
I would like to get a dataframe with the following columns by joining (left) on county_ID = countyid
:
joined_dataframe
event_id, date, time, county, state
I cannot figure out how to do it if the columns on which I want to join are not the index. What's the easiest way? Thanks!
you can use the left_on and right_on options as follows:
pd.merge(frame_1, frame_2, left_on='county_ID', right_on='countyid')
I was not sure from the question if you only wanted to merge if the key was in the left hand dataframe. If that is the case then the following will do that (the above will in effect do a many to many merge)
pd.merge(frame_1, frame_2, how='left', left_on='county_ID', right_on='countyid')
you need to make county_ID
as index for the right frame:
frame_2.join ( frame_1.set_index( [ 'county_ID' ], verify_integrity=True ),
on=[ 'countyid' ], how='left' )
for your information, in pandas left join breaks when the right frame has non unique values on the joining column. see this bug.
so you need to verify integrity before joining by , verify_integrity=True