Skip to content

Latest commit

 

History

History
98 lines (98 loc) · 22.6 KB

tasks.md

File metadata and controls

98 lines (98 loc) · 22.6 KB
Task Name Description
Analogical Problem Solving Using analogies to solve problems by applying solutions from one domain to another similar situation.
Analogy Creation Creating analogies to compare different concepts, situations, or objects.
Analyzing Cultural Differences Comparing and contrasting different cultural practices, beliefs, or norms.
Analyzing Decision Making Processes Examining and evaluating decision-making processes, including steps, factors, and reasoning.
Analyzing Decision Trees Interpreting and evaluating decision trees to understand decision-making processes.
Analyzing Historical Counterfactuals Considering alternative outcomes of historical events by changing key factors or decisions.
Analyzing Rhetorical Strategies Identifying and evaluating rhetorical strategies used in a given text or speech.
Assessing Risk And Uncertainty Evaluating scenarios with incomplete information to determine potential risks and uncertainties.
Bias Detection Identifying and explaining biases present in given scenarios, statements, or data.
Bias Mitigation Constructing a statement as close to the ground truth as possible, given a statement and the bias that led to it.
Calculating Probabilities Calculating probabilities for various scenarios, including simple and compound events.
Categorizing Information Into Hierarchies Organizing information into hierarchical structures based on relationships or logical criteria.
Causal Chain Analysis Identifying and analyzing a sequence of events or factors that lead to a specific outcome.
Completing Analogies Completing analogies to evaluate the ability to recognize relationships between pairs of words and apply them to new contexts.
Constructing Valid Arguments Creating logically sound arguments to support a given conclusion or claim.
Counterfactual Analysis Examining hypothetical scenarios that are contrary to what actually happened.
Critical Factor Identification in Theory of Mind Understanding that similar agents may act differently, or different agents may act similarly, based on a third factor.
Critiquing Argument Structures Analyzing and evaluating the structure, logic, and effectiveness of arguments.
Curry's Paradox Examining a specific form of semantic paradox that seemingly proves arbitrary claims through self-reference and logical implication.
Deciphering Ambiguous Instructions Interpreting and clarifying unclear or incomplete instructions.
Deconstructing Complex Systems Breaking down complex systems into their constituent parts and explaining how these parts interact.
Deconstructing Metaphors Analyzing and explaining the meaning behind metaphors.
Deducing Motives From Actions Analyzing actions of individuals or groups to infer their underlying motivations or intentions.
Deducing Rules From Examples Analyzing examples to infer the underlying rule or pattern.
Deductive Logic Puzzles Solving deductive logic puzzles to evaluate the ability to use given information, make logical inferences, and arrive at a correct conclusion.
Describing Spatial Relationships Accurately describing the relative positions and orientations of objects in space.
Detecting Sarcasm And Irony Identifying and explaining instances of sarcasm or irony in given statements or scenarios.
Determining Alternative Outcomes Analyzing historical events or decisions and reasoning about possible alternative outcomes if key factors had been different.
Distinguishing Correlation from Causation Analyzing given scenarios or statistical relationships to identify cases where correlation does not imply causation.
Distinguishing Fact From Opinion Differentiating between factual statements and opinions in given texts or scenarios.
Equation Derivation Deriving mathematical equations from given information or scenarios to evaluate the ability to translate word problems into mathematical expressions and manipulate them to reach a solution.
Estimating Duration Estimating the time required for various activities or processes.
Ethical Dilemma Resolution Analyzing complex ethical scenarios and proposing reasoned solutions.
Evaluating Analogies For Accuracy Assessing given analogies for their accuracy and appropriateness.
Evaluating Competing Theories Analyzing and comparing multiple theories for a phenomenon, assessing their strengths and weaknesses, and determining which is best supported by evidence.
Evaluating Policy Implications Analyzing proposed policies or decisions and predicting their potential consequences across various domains.
Evaluating Source Credibility Assessing the reliability and trustworthiness of various information sources.
Fermi Estimation Making rough numerical estimates for complex questions using logical reasoning and educated guesses.
First Order False Belief Identifying why a misinformed agent may behave contrary to reality due to inaccurate beliefs.
First Order Ignorance Identifying why an agent may lack knowledge or awareness of certain facts or events.
Forecasting Technological Impacts Predicting and analyzing potential effects of emerging or hypothetical technologies on society, economy, and daily life.
Generating Creative Solutions Developing innovative and unique solutions to given problems or challenges.
Higher Order False Belief Handling a complex chain of agent's beliefs about the knowledge (and accuracy of the knowledge) of other agents to ultimately predict the behavior of an agent.
Hypothesis Formation Generating plausible hypotheses to explain observed phenomena or solve problems.
Identifying Anachronisms Recognizing elements that are out of place in a given historical context.
Identifying Cause and Effect Relationships Analyzing given scenarios or statements to identify and explain cause and effect relationships present.
Identifying Cognitive Biases Recognizing and explaining cognitive biases in given scenarios or decision-making processes.
Identifying Hallucination Prone Questions Recognizing questions that are likely to lead to hallucination or questions it simply doesn't know the answer to.
Identifying Implicit Biases In Language Recognizing subtle biases embedded in language use.
Identifying Logical Fallacies Identifying and explaining common logical fallacies in given arguments or statements to evaluate the ability to recognize flawed reasoning.
Identifying Logical Inconsistencies Detecting and explaining logical inconsistencies or contradictions within given information.
Identifying Relationships Identifying the relationship between pairs of words or concepts to evaluate the ability to recognize various types of connections and articulate them clearly.
Identifying Unstated Assumptions Recognizing and articulating implicit assumptions in statements, arguments, or scenarios.
Inference Drawing From Incomplete Data Making logical deductions or inferences based on limited or incomplete information.
Inferring Emotional States Analyzing scenarios to infer people's emotional states based on their behavior and context.
Inferring Motivations From Actions Analyzing described actions or behaviors to deduce the underlying motivations, intentions, or goals of the individuals involved.
Interpreting Ambiguous Statements Analyzing statements with multiple possible interpretations and identifying different ways they can be understood.
Interpreting and Creating Timelines Reading or creating timelines to represent a series of events or processes.
Interpreting Body Language Cues Analyzing and interpreting non-verbal communication signals, such as facial expressions, postures, and gestures.
Interpreting Legal Language And Precedents Analyzing and interpreting legal texts, statutes, or case law to understand their implications and applications.
Interpreting Nonverbal Communication Analyzing and interpreting nonverbal cues in human communication.
Interpreting Statistical Data Analyzing and interpreting statistical data presented in various formats.
Lateral Thinking Puzzles Solving lateral thinking puzzles to evaluate the ability to think creatively, consider unconventional scenarios, and ask relevant questions to reach the correct solution.
Mathematical Word Problems Solving mathematical word problems to evaluate the ability to interpret real-world scenarios, extract relevant information, and perform appropriate calculations.
Mental Rotation Tasks Mentally rotating objects or shapes and predicting their appearance from different angles.
Moral Reasoning In Everyday Situations Analyzing everyday scenarios that present moral dilemmas and reasoning through the ethical implications of different actions.
Narrative Gap Filling Filling in missing information or events in a narrative to create a coherent story.
Parsing Complex Sentences Analyzing sentences to identify grammatical structures and explain relationships between parts.
Pattern Recognition in Spatial Arrangements Identifying patterns or rules inentifying patterns or rules in the spatial arrangement of objects or shapes.
Perspective Taking In Social Scenarios Analyzing social situations from different viewpoints to understand the motivations, emotions, and potential reactions of various parties involved.
Predicting Market Trends Analyzing economic indicators and data to forecast potential future market trends.
Predicting Outcomes Based on Scenarios Analyzing given scenarios and predicting potential outcomes based on the information provided.
Prioritizing Conflicting Goals Analyzing and resolving situations with conflicting objectives, requiring trade-offs and strategic decision-making.
Proof Verification Verifying mathematical proofs to evaluate the ability to understand logical arguments, identify correct steps in a proof, and spot errors or gaps in reasoning.
Recognizing Emotional Subtext Identifying and interpreting underlying emotional content or implications in text that are not explicitly stated.
Recognizing Patterns In Behavior Identifying recurring patterns or trends in human or animal behavior based on given scenarios or data.
Recognizing Patterns In Sequences Identifying and extending patterns in numerical, alphabetical, or symbolic sequences.
Reconciling Conflicting Information Analyzing and resolving contradictory information from multiple sources.
Reverse Engineering Processes Analyzing a final result and working backwards to determine the steps or components that led to that outcome.
Risk Assessment In Decision Making Evaluating potential risks and benefits associated with different courses of action in a given scenario.
Second Order False Belief Understanding that an agent may hold a false belief about another agent's belief, leading to misinterpretations of actions or intentions.
Sequencing Events Arranging a set of events in chronological order.
Solving Riddles And Word Puzzles Deciphering and solving various types of riddles and word puzzles.
Solving Word Problems With Multiple Variables Translating word problems into mathematical equations and solving them.
Spatial Problem Solving Using spatial reasoning to solve practical problems or puzzles.
[Stack Based Reasoning] (https://github.com/NousResearch/Open-Reasoning-Tasks/blob/main/tasks/stack-based-reasoning) Using stacks and reverse thinking to convert chain of thought into stacks of instructions for others to follow
Syllogism Reasoning Providing a series of syllogisms to evaluate logical reasoning capabilities.
Trait Attribution In Behavioral Scenarios Analyzing described behaviors or actions and inferring personality traits or characteristics that might explain those behaviors.
Trend Analysis And Forecasting Examining historical data or patterns to identify trends and make predictions about future outcomes.
Truth Table Completion Completing truth tables for given logical expressions to evaluate the understanding of Boolean logic and ability to determine the truth value of complex statements.
Truth Table Completions Completing truth tables for given logical expressions.
Towers of Hanoi The Tower of Hanoi is a puzzle where you must move a stack of disks from one rod to another, obeying rules about disk size and movement.
Understanding Time Based Relationships Analyzing and explaining relationships between events based on their timing.
Understanding Time Zones and Global Time Differences Calculating time differences across various time zones and understanding how global time works.
Unraveling Paradoxes Analyzing and explaining paradoxes or logical puzzles.
Multiturn Latex Generation Generating latex documents and suggesting edits using multiturn instructions.