The traditional leadership capabilities, such as goal analysis, constraint analysis, planning, forecasting, and idea evaluation, are found wanting in an Artificial Intelligence (AI)-driven environment. To complement traditional capabilities, a new form of human-machine collaborative capabilities has been called for to ensure higher but more responsible performance in AI-driven organizational environments. We conducted a systematic literature review to explore the extant literature on leadership in the AI context with two specific aims. First, this review aims to identify the essential AI-driven capabilities in responsible leadership. The second is to synthesize the systematic review findings into an integrated conceptual framework to highlight how leaders in AI-driven organizations could perform more responsibly. Describing the developments and trends in leadership in AI-driven organizations, the paper includes propositions and future research opportunities on how leaders in AI-driven organizations could perform better and more responsibly.