1.背景业务数据不断增大,Spark运行时间越来越长,从最初的半小时到6个多小时某日Spark程序运行6.5个小时后,报“Too large frame.”的异常org.apache.spark.shuffle.FetchFailedException:Too large frame:26246804162...
某日,研发的小伙伴扔过来一个SQL希望帮忙优化。select nation,province,city from ip_idc where ip_start<'113.201.214.203':inet and ip_end>'113.201.214.203':inet;这个SQL需要执行1秒多。而业务需要高...