Analogical Problem Solving |
Using analogies to solve problems by applying solutions from one domain to another similar situation. |
Analogy Creation |
Creating analogies to compare different concepts, situations, or objects. |
Analyzing Cultural Differences |
Comparing and contrasting different cultural practices, beliefs, or norms. |
Analyzing Decision Making Processes |
Examining and evaluating decision-making processes, including steps, factors, and reasoning. |
Analyzing Decision Trees |
Interpreting and evaluating decision trees to understand decision-making processes. |
Analyzing Historical Counterfactuals |
Considering alternative outcomes of historical events by changing key factors or decisions. |
Analyzing Rhetorical Strategies |
Identifying and evaluating rhetorical strategies used in a given text or speech. |
Assessing Risk And Uncertainty |
Evaluating scenarios with incomplete information to determine potential risks and uncertainties. |
Bias Detection |
Identifying and explaining biases present in given scenarios, statements, or data. |
Bias Mitigation |
Constructing a statement as close to the ground truth as possible, given a statement and the bias that led to it. |
Calculating Probabilities |
Calculating probabilities for various scenarios, including simple and compound events. |
Categorizing Information Into Hierarchies |
Organizing information into hierarchical structures based on relationships or logical criteria. |
Causal Chain Analysis |
Identifying and analyzing a sequence of events or factors that lead to a specific outcome. |
Completing Analogies |
Completing analogies to evaluate the ability to recognize relationships between pairs of words and apply them to new contexts. |
Constructing Valid Arguments |
Creating logically sound arguments to support a given conclusion or claim. |
Counterfactual Analysis |
Examining hypothetical scenarios that are contrary to what actually happened. |
Critical Factor Identification in Theory of Mind |
Understanding that similar agents may act differently, or different agents may act similarly, based on a third factor. |
Critiquing Argument Structures |
Analyzing and evaluating the structure, logic, and effectiveness of arguments. |
Curry's Paradox |
Examining a specific form of semantic paradox that seemingly proves arbitrary claims through self-reference and logical implication. |
Deciphering Ambiguous Instructions |
Interpreting and clarifying unclear or incomplete instructions. |
Deconstructing Complex Systems |
Breaking down complex systems into their constituent parts and explaining how these parts interact. |
Deconstructing Metaphors |
Analyzing and explaining the meaning behind metaphors. |
Deducing Motives From Actions |
Analyzing actions of individuals or groups to infer their underlying motivations or intentions. |
Deducing Rules From Examples |
Analyzing examples to infer the underlying rule or pattern. |
Deductive Logic Puzzles |
Solving deductive logic puzzles to evaluate the ability to use given information, make logical inferences, and arrive at a correct conclusion. |
Describing Spatial Relationships |
Accurately describing the relative positions and orientations of objects in space. |
Detecting Sarcasm And Irony |
Identifying and explaining instances of sarcasm or irony in given statements or scenarios. |
Determining Alternative Outcomes |
Analyzing historical events or decisions and reasoning about possible alternative outcomes if key factors had been different. |
Distinguishing Correlation from Causation |
Analyzing given scenarios or statistical relationships to identify cases where correlation does not imply causation. |
Distinguishing Fact From Opinion |
Differentiating between factual statements and opinions in given texts or scenarios. |
Equation Derivation |
Deriving mathematical equations from given information or scenarios to evaluate the ability to translate word problems into mathematical expressions and manipulate them to reach a solution. |
Estimating Duration |
Estimating the time required for various activities or processes. |
Ethical Dilemma Resolution |
Analyzing complex ethical scenarios and proposing reasoned solutions. |
Evaluating Analogies For Accuracy |
Assessing given analogies for their accuracy and appropriateness. |
Evaluating Competing Theories |
Analyzing and comparing multiple theories for a phenomenon, assessing their strengths and weaknesses, and determining which is best supported by evidence. |
Evaluating Policy Implications |
Analyzing proposed policies or decisions and predicting their potential consequences across various domains. |
Evaluating Source Credibility |
Assessing the reliability and trustworthiness of various information sources. |
Fermi Estimation |
Making rough numerical estimates for complex questions using logical reasoning and educated guesses. |
First Order False Belief |
Identifying why a misinformed agent may behave contrary to reality due to inaccurate beliefs. |
First Order Ignorance |
Identifying why an agent may lack knowledge or awareness of certain facts or events. |
Forecasting Technological Impacts |
Predicting and analyzing potential effects of emerging or hypothetical technologies on society, economy, and daily life. |
Generating Creative Solutions |
Developing innovative and unique solutions to given problems or challenges. |
Higher Order False Belief |
Handling a complex chain of agent's beliefs about the knowledge (and accuracy of the knowledge) of other agents to ultimately predict the behavior of an agent. |
Hypothesis Formation |
Generating plausible hypotheses to explain observed phenomena or solve problems. |
Identifying Anachronisms |
Recognizing elements that are out of place in a given historical context. |
Identifying Cause and Effect Relationships |
Analyzing given scenarios or statements to identify and explain cause and effect relationships present. |
Identifying Cognitive Biases |
Recognizing and explaining cognitive biases in given scenarios or decision-making processes. |
Identifying Hallucination Prone Questions |
Recognizing questions that are likely to lead to hallucination or questions it simply doesn't know the answer to. |
Identifying Implicit Biases In Language |
Recognizing subtle biases embedded in language use. |
Identifying Logical Fallacies |
Identifying and explaining common logical fallacies in given arguments or statements to evaluate the ability to recognize flawed reasoning. |
Identifying Logical Inconsistencies |
Detecting and explaining logical inconsistencies or contradictions within given information. |
Identifying Relationships |
Identifying the relationship between pairs of words or concepts to evaluate the ability to recognize various types of connections and articulate them clearly. |
Identifying Unstated Assumptions |
Recognizing and articulating implicit assumptions in statements, arguments, or scenarios. |
Inference Drawing From Incomplete Data |
Making logical deductions or inferences based on limited or incomplete information. |
Inferring Emotional States |
Analyzing scenarios to infer people's emotional states based on their behavior and context. |
Inferring Motivations From Actions |
Analyzing described actions or behaviors to deduce the underlying motivations, intentions, or goals of the individuals involved. |
Interpreting Ambiguous Statements |
Analyzing statements with multiple possible interpretations and identifying different ways they can be understood. |
Interpreting and Creating Timelines |
Reading or creating timelines to represent a series of events or processes. |
Interpreting Body Language Cues |
Analyzing and interpreting non-verbal communication signals, such as facial expressions, postures, and gestures. |
Interpreting Legal Language And Precedents |
Analyzing and interpreting legal texts, statutes, or case law to understand their implications and applications. |
Interpreting Nonverbal Communication |
Analyzing and interpreting nonverbal cues in human communication. |
Interpreting Statistical Data |
Analyzing and interpreting statistical data presented in various formats. |
Lateral Thinking Puzzles |
Solving lateral thinking puzzles to evaluate the ability to think creatively, consider unconventional scenarios, and ask relevant questions to reach the correct solution. |
Mathematical Word Problems |
Solving mathematical word problems to evaluate the ability to interpret real-world scenarios, extract relevant information, and perform appropriate calculations. |
Mental Rotation Tasks |
Mentally rotating objects or shapes and predicting their appearance from different angles. |
Moral Reasoning In Everyday Situations |
Analyzing everyday scenarios that present moral dilemmas and reasoning through the ethical implications of different actions. |
Narrative Gap Filling |
Filling in missing information or events in a narrative to create a coherent story. |
Parsing Complex Sentences |
Analyzing sentences to identify grammatical structures and explain relationships between parts. |
Pattern Recognition in Spatial Arrangements |
Identifying patterns or rules inentifying patterns or rules in the spatial arrangement of objects or shapes. |
Perspective Taking In Social Scenarios |
Analyzing social situations from different viewpoints to understand the motivations, emotions, and potential reactions of various parties involved. |
Predicting Market Trends |
Analyzing economic indicators and data to forecast potential future market trends. |
Predicting Outcomes Based on Scenarios |
Analyzing given scenarios and predicting potential outcomes based on the information provided. |
Prioritizing Conflicting Goals |
Analyzing and resolving situations with conflicting objectives, requiring trade-offs and strategic decision-making. |
Proof Verification |
Verifying mathematical proofs to evaluate the ability to understand logical arguments, identify correct steps in a proof, and spot errors or gaps in reasoning. |
Recognizing Emotional Subtext |
Identifying and interpreting underlying emotional content or implications in text that are not explicitly stated. |
Recognizing Patterns In Behavior |
Identifying recurring patterns or trends in human or animal behavior based on given scenarios or data. |
Recognizing Patterns In Sequences |
Identifying and extending patterns in numerical, alphabetical, or symbolic sequences. |
Reconciling Conflicting Information |
Analyzing and resolving contradictory information from multiple sources. |
Reverse Engineering Processes |
Analyzing a final result and working backwards to determine the steps or components that led to that outcome. |
Risk Assessment In Decision Making |
Evaluating potential risks and benefits associated with different courses of action in a given scenario. |
Second Order False Belief |
Understanding that an agent may hold a false belief about another agent's belief, leading to misinterpretations of actions or intentions. |
Sequencing Events |
Arranging a set of events in chronological order. |
Solving Riddles And Word Puzzles |
Deciphering and solving various types of riddles and word puzzles. |
Solving Word Problems With Multiple Variables |
Translating word problems into mathematical equations and solving them. |
Spatial Problem Solving |
Using spatial reasoning to solve practical problems or puzzles. |
[Stack Based Reasoning] (https://github.com/NousResearch/Open-Reasoning-Tasks/blob/main/tasks/stack-based-reasoning) Using stacks and reverse thinking to convert chain of thought into stacks of instructions for others to follow |
|
Syllogism Reasoning |
Providing a series of syllogisms to evaluate logical reasoning capabilities. |
Trait Attribution In Behavioral Scenarios |
Analyzing described behaviors or actions and inferring personality traits or characteristics that might explain those behaviors. |
Trend Analysis And Forecasting |
Examining historical data or patterns to identify trends and make predictions about future outcomes. |
Truth Table Completion |
Completing truth tables for given logical expressions to evaluate the understanding of Boolean logic and ability to determine the truth value of complex statements. |
Truth Table Completions |
Completing truth tables for given logical expressions. |
Towers of Hanoi |
The Tower of Hanoi is a puzzle where you must move a stack of disks from one rod to another, obeying rules about disk size and movement. |
Understanding Time Based Relationships |
Analyzing and explaining relationships between events based on their timing. |
Understanding Time Zones and Global Time Differences |
Calculating time differences across various time zones and understanding how global time works. |
Unraveling Paradoxes |
Analyzing and explaining paradoxes or logical puzzles. |
Multiturn Latex Generation |
Generating latex documents and suggesting edits using multiturn instructions. |